[Bacula-users] Daemon messages during catalog backup
Hi everyone, I read that PDF file: https://blog.bacula.org/whitepapers/CommunityDiskBackup.pdf and applied §§ 1.1, 1.2, 1.4. Scripts do their job correctly. But... When the RunScript "purge volume action=truncate allpools storage=[...]" runs, the "Daemon" message resource send a mail with such things: 11-déc. 11:47 carina-dir JobId 0: 3000 OK label. VolBytes=209 VolABytes=0 VolType=1 Volume="Vol0171" Device="DEV-home-DRV2" (/home/bacula) 11-déc. 11:47 carina-dir JobId 0: The volume "Vol0171" has been truncated 11-déc. 11:47 carina-dir JobId 0: 3000 OK label. VolBytes=209 VolABytes=0 VolType=1 Volume="Vol0008" Device="DEV-home-DRV2" (/home/bacula) 11-déc. 11:47 carina-dir JobId 0: The volume "Vol0008" has been truncated As everything is working fine, I would like not to receive this mail. What I would like: If the catalog backup failed due to a daemon error, I want an alert (today, a mail, tomorrow, a zabbix alert) If the catalog backup ran fine and scripts ran fine, I would like the job to be quiet Is there a way to do it nicely? Best regards. Jérôme Blion. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] deal with Bacula database growth
HI, I just thought about something you may have not setup yet. Do you regularly check your catalog with bcheck ? Typically, weekly, I run the following command: /usr/bin/yes yes | /usr/sbin/dbcheck -c /etc/bacula/bacula-dir.conf -C Catalog1 -b -f It cleans lot of mess in the database. HTH. Jérôme Blion. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] deal with Bacula database growth
Le 08/10/2018 à 16:42, krashoverr...@free.fr a écrit : Hey there, What are the best practices to deal with Bacula database size? Today i have configured my bacula for daily + weekly + monthly backups. Daily and Weekly pools have a volume retention period of 30 days while Monthly pool has no volume retention. Bacula is running from ~1 year, i have ~2.8To to backup, and I guess, because of the "no retention" policy, my database is now 13Gb. Considering I have no choice but to keep all my mensual backups, anything I can do to "extract" these mensual backups from my catalog, while still having the possibility to restore any of them "as fast as I can" ? If I purge jobs from catalog, I won't be able to restore a single file/folder from tapes, but will have to bextract the whole tape and dig inside. If I create (let's say) yearly catalogs, I will lost my media database every year. Any suggestion appreciated! Thank you, Thibault Hello, Volume retention is related to volume management (space used for volumes) File and Job Retention are linked to the catalog. You have to check that you don't store Files and Jobs records too much time.HTH. HTH Jérôme Blion. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] label command frequently fails
Le 27/09/2018 à 05:38, Gary Dale a écrit : On 2018-09-26 11:33 AM, Bill Arlofski wrote: On 09/26/2018 06:22 AM, Martin Simmons wrote: Try setdebug level=150 trace=1 Storage and look for a file matching *.trace (probably in the SD's WorkingDirectory). ...and you can also add options=t to have timestamps in the *.trace file. Best regards, Bill I was waiting for the label command to fail again. It didn't take long. The bconsole messages were the same. The trace doesn't tell me anything new. Hopefully you understand it better than I. Here's the output from the trace: #cat /var/lib/bacula/bacula-sd.trace bacula-sd: bnet.c:566-0 who=client host=192.168.1.17 port=9103 bacula-sd: dircmd.c:178-0 Got a DIR connection at 26-Sep-2018 23:30:25 bacula-sd: cram-md5.c:69-0 send: auth cram-md5 challenge <56845663.1538019025@bacula-sd> ssl=0 bacula-sd: cram-md5.c:133-0 cram-get received: auth cram-md5 <554803286.1538019025@bacula-dir> ssl=0 bacula-sd: cram-md5.c:157-0 sending resp to challenge: cH+vQ7+Fdw/6P7+9R7/jRA bacula-sd: dircmd.c:204-0 Message channel init completed. bacula-sd: dircmd.c:806-0 Found device FileStorage bacula-sd: dircmd.c:850-0 Found device FileStorage bacula-sd: block_util.c:143-0 New block len=64512 block=7f19c8001160 bacula-sd: acquire.c:673-0 Attach 0xc8001c78 to dev "FileStorage" (/home/shares/backup) bacula-sd: vol_mgr.c:657-0 find_read_vol: read_vol_list empty. bacula-sd: vol_mgr.c:851-0 Vol=weekly-backup-pool-37 not in use. bacula-sd: vol_mgr.c:381-0 enter reserve_volume=weekly-backup-pool-37 drive="FileStorage" (/home/shares/backup) bacula-sd: vol_mgr.c:286-0 new Vol=weekly-backup-pool-37 slot=0 at 7f19c8011e88 dev="FileStorage" (/home/shares/backup) bacula-sd: vol_mgr.c:547-0 set in_use. vol=weekly-backup-pool-37 dev="FileStorage" (/home/shares/backup) bacula-sd: vol_mgr.c:581-0 Inc walk_start use_count=2 volname=weekly-backup-pool-37 bacula-sd: vol_mgr.c:220-0 List end new volume: weekly-backup-pool-37 in_use=1 swap=0 slot=0 on file device "FileStorage" (/home/shares/backup) bacula-sd: vol_mgr.c:693-0 Clear in_use vol=weekly-backup-pool-37 slot=0 bacula-sd: vol_mgr.c:710-0 set not reserved vol=weekly-backup-pool-37 slot=0 writers=1 reserves=0 dev="FileStorage" (/home/shares/backup) bacula-sd: vol_mgr.c:740-0 Clear in_use vol=weekly-backup-pool-37 slot=0 bacula-sd: vol_mgr.c:746-0 Remove volume weekly-backup-pool-37 slot=0 dev="FileStorage" (/home/shares/backup) bacula-sd: mount.c:384-3298 Again dir_find_next_append... bacula-sd: mount.c:374-3298 No appendable volume. Calling wait_for_device bacula-sd: wait.c:270-3298 Enter wait_for_device. busy=1 dcrvol= devvol= bacula-sd: mount.c:384-3298 Again dir_find_next_append... bacula-sd: mount.c:374-3298 No appendable volume. Calling wait_for_device bacula-sd: wait.c:270-3298 Enter wait_for_device. busy=1 dcrvol= devvol= bacula-sd: mount.c:384-3298 Again dir_find_next_append... bacula-sd: mount.c:374-3298 No appendable volume. Calling wait_for_device bacula-sd: wait.c:270-3298 Enter wait_for_device. busy=1 dcrvol= devvol= Hello, Did you add the volume before trying to label it? Could you provide us commands you used? HTH Jérôme. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] label command frequently fails
Le 20/09/2018 à 05:23, Gary Dale a écrit : On 2018-09-19 05:35 PM, Jérôme Blion wrote: Le 19/09/2018 à 21:40, Gary Dale a écrit : I'm running bacula 7.4.4 on a Debian/Stretch AMD64 server. When I try to create a new disk volume for my steadily increasing amount of data needing to be backed up, it usually fails after I create the first new volume. There is lots of free space on the disk, so it's not that. Eventually I might be able to create another new volume (possibly because of an intervening reboot) but in the meanwhile I only have the one new volume (25G) which is about 1/10 the size of a full backup... Here's an example of what I see in bconsole when executing the label command: Sending label command for Volume "weekly-backup-pool-30" Slot 0 ... 3934 Device ""FileStorage" (/home/shares/backup)" is being initialized. Label command failed for Volume weekly-backup-pool-30. Do not forget to mount the drive!!! Any ideas on what is happening and how to fix it? Thanks. Hello, why don't you let bacula create volumes when needed ? Because I didn't start with them that way and bacula doesn't like you to change volume labels once assigned. It wants to create new volumes with a 4-digit serial number ending. I've been using 2-digits. The manual recommends using python scripts for this which I don't want to get into to save myself what should be a few minutes every few months. http://www.bacula.org/7.4.x-manuals/en/misc/Variable_Expansion.html Perhaps you should do some tests to see if if can create volumes according to your naming convention. You should avoid any manual action regarding your backup solution. That's a troubles source. Moreover, it isn't guaranteed to resolve the problem I'm having. If bacula can't label a volume manually through bconsole, why should I expect it to do so automatically? I'd still also need to monitor the number of volumes / amount of disk space bacula is taking so it might not actually save me any time. It just gives me a different thing to worry about. http://www.bacula.org/7.4.x-manuals/en/main/Basic_Volume_Management.html When using automatic volume creation, you should use: Maximum Volume Bytes = 50G # Limit Volume size to something reasonable Maximum Volumes = 10 # Limit number of Volumes in Pool This way, you don't have to worry about disk filling. HTH. Jérôme Blion. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] label command frequently fails
Le 19/09/2018 à 21:40, Gary Dale a écrit : I'm running bacula 7.4.4 on a Debian/Stretch AMD64 server. When I try to create a new disk volume for my steadily increasing amount of data needing to be backed up, it usually fails after I create the first new volume. There is lots of free space on the disk, so it's not that. Eventually I might be able to create another new volume (possibly because of an intervening reboot) but in the meanwhile I only have the one new volume (25G) which is about 1/10 the size of a full backup... Here's an example of what I see in bconsole when executing the label command: Sending label command for Volume "weekly-backup-pool-30" Slot 0 ... 3934 Device ""FileStorage" (/home/shares/backup)" is being initialized. Label command failed for Volume weekly-backup-pool-30. Do not forget to mount the drive!!! Any ideas on what is happening and how to fix it? Thanks. Hello, why don't you let bacula create volumes when needed ? HTH. Jérôme Blion. ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] restoring from old backup
Le 05/09/2018 à 10:56, Adam Weremczuk a écrit : Also, to my surprise, I've just received this message: 05-Sep 09:24 backup_dir JobId 0: Max configured use duration=172,800 sec. exceeded. Marking Volume "LTO-M20120606A" as Used. 05-Sep 09:24 backup_dir JobId 0: There are no more Jobs associated with Volume "LTO-M20130703A". Marking it purged. 05-Sep 09:24 backup_dir JobId 0: Recycled volume "LTO-M20130703A" I haven't made any config changes, just did a couple of listings and attempted one restore which I aborted. Weird... Check Volume Use Duration in your setup. On 05/09/18 09:47, Adam Weremczuk wrote: Hi all, I'm using Bacula 5.2.6 with LTO-4. Today I've tried restoring an single file (/var/log/auth.log) from an old backup and encountered the following: ++---+---+-+-++ | JobId | Level | JobFiles | JobBytes | StartTime | VolumeName | ++---+---+-+-++ | 35,038 | F | 3,040,903 | 441,031,349,224 | 2016-05-04 22:10:01 | LTO-R20160504A | ++---+---+-+-++ You have selected the following JobId: 35038 Building directory tree for JobId(s) 35038 ... For one or more of the JobIds selected, no files were found, so file selection is not possible. Most likely your retention policy pruned the files. Do you want to restore all the files? (yes|no): no Regexp matching files to restore? (empty to abort): Restore not done. Check File Retention and Job Retention. I suppose they are much lower than volume retention. That means that you keep the volume but you don't know exactly what's on it because catalog has been cleaned up. HTH. Jérôme Blion. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] rookie questions concerning retention times
Hi Matthias,
Le 24/08/2018 à 12:36, Matthias Leopold a écrit :
.) I want to increase job and file retention times for existing
entries. I didn't fully understand if
(a) this possible at all
Sure it is.
(b) involves database updates (didn't find a way) or
Job / File retention changes should only be made through configuration
files + bconsole reload.
Anyway, modifying these two parameters will make the catalog's size
increase.
If you change volume retention, you would probably have to update your
volumes in pools you modified.
(c) is simply a matter of updating Client or Pool resources.
Job / File retention can be defined in both parts.
Pool's parameters takes precedence over Client's ones.
.) I have the simple situation where a full backup for a job exists
and since then only incremental backups where made, there are no
further full backups scheduled. What happens when Job/File/Volume
retention times (all the same in this case) start to expire ("prune
expired volume yes" + "purge volume action=truncate allpools
storage=foo" are executed)?
Will new incremental backups fail as soon as the initial full backup
expires?
Will the next incremental backup be upgraded to full?
Will the existing incremental backups be accessible in any way when
there is no full backup any more?
As soon as the full will expire, the next incremental will be upgraded
to full.
Incremental backups without prior full backup won't be easily accessible
then. And you could quickly face troubles :
- you won't be able to restore files which have never been backed up
by incremental jobs <=== data loss
- the restore command in bconsole will often block you because it will
be unable to build the directory tree. <=== hard to restore
You have several options:
- ensure you always have enough full backups. If you want to be able
to restore a 1 month old backup job, that means, you should keep the
full backup more than 2 months (or it will be purged wherease some
incremental / diffs still need it). You would have to use different
pools to manage different retentions.
- use Progressive Virtual Full backup. It may help you to manage the
space you need to do your backups. I don't use this option yet so I
won't be able to help you more.
Hope this helps.
Jérôme.
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Reclaiming Disc Space
Le 16/08/2018 à 23:37, Chris Wilkinson a écrit :
I did. I implemented the runscript mentioned there that runs daily.
Job {
Name = CatalogBackup ...
RunScript {
RunsWhen=After
RunsOnClient=No
Console = "purge volume action=truncate allpools storage=File"
}
}
This doesn't seem to be having the desired effect. Volumes are not
being truncated though I can truncate them manually with bconsole
truncate if they are first purged.
The thing that puzzles me about this is the storage= statement since I
have multiple storages defined.
It seems that truncate will only work on purged volumes and volumes
will not be purged until their retention time is up.
Regards
Chris Wilkinson
Hello,
Beware :
* File / Job retentions only have an impact on the catalog's size.
* Volume retention is the only one related to the space consumed by
tapes. A volume won't be reclaimed until Volume Retention expires.
Did you also implement these following rules in pools' definitions (with
different values of course):
Volume Retention = 42 days # 6 weeks
Maximum Volume Bytes = 50G # Limit Volume size to something
reasonable
Maximum Volumes = 10 # Limit number of Volumes in Pool
Recycle Oldest Volume = yes
RecyclePool = Scratch
Action On Purge = Truncate
If you don't define these rules, volumes won't be recycled automatically.
HTH.
Jérôme Blion
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Reclaiming Disc Space
Le 16/08/2018 à 13:56, Radosław Korzeniewski a écrit : Hello, 2018-08-15 17:45 GMT+02:00 Chris Wilkinson <mailto:winstonia...@gmail.com>>: I'm approaching 100% capacity on my backup storage so will soon start running into out of space warnings. Is there a way that the disc space used by volumes with no associated jobs can be reclaimed and the storage made available for reuse? You can use a truncate command for that. Hi, Did you have a look on that: https://blog.bacula.org/whitepapers/CommunityDiskBackup.pdf HTH Jérôme Blion. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] read tape label from bash
I'm aware of bconsole, btape etc. but they are all interactive consoles. You could use that: bconsole < <(echo "status storage") Or if you want something more specific, you could use the expect command. Perhaps the data pieces you want can be retrieved through sg_utils, but I don't know how (I'm using disks)JTH. HTH Jérôme. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tapes running out of space
Hi, LTO-4 are supposed to store 800GB uncompressed. That's the only value you can expect from the tape. Depending on the data pieces you want to backup, you can have a ratio lower than 2. If data pieces are already compressed you won't have a good compression ratio. Is the capacity dynamic, i.e. decreases with the number of writes as tapes age and wear down? It could make sense as the tape from February was put in service in 2014 and the one from July in 2011. According to Wikipedia, a tape could last up to 30 years and 2 mounts/unmounts. You will be able to identify tapes when they will generate read / writes issues in a clean drive. HTH. Jérôme Blion. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Baculum 9.2.0 binary packages
Hi Marcin, There is a typo. When you are looking at volumes in a pool, the column name "First written" is in fact filled with "last written" value. HTH. Jérôme Blion. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Full jobs pruned before differential / incremental retention
Le 25/06/2018 à 11:37, Jérôme Blion a écrit :
Hello everyone,
I have a Bacula 7.4.4 installed on a Debian Stretch. I set it up when
it was a 5.2.6 version. I want to have a 35 days retention for "flat
files". I set File retention and Job retention to 35 days on each
client declared.
Client {
Name = ...-fd
Address = ...
FDPort = 9102
Catalog = Catalog1
Password = "..." # password for FileDaemon
File Retention = 35 days # 1 Month
Job Retention = 35 days # 1 Month
AutoPrune = yes # Prune expired Jobs/Files
Maximum Concurrent Jobs = 20
}
To restore a 30 days old file, I need at least one full backup that
may be older than 30 days. To keep 2 full backup, I set up volume
Retention to 70 days:
Pool {
Name = POL-35D
Pool Type = Backup
Recycle = yes # Bacula can automatically
recycle Volumes
LabelFormat = "Vol"
AutoPrune = yes # Prune expired volumes
Volume Retention = 70 days # one month
Maximum Volume Bytes = 50G # Limit Volume size to something
reasonable
Maximum Volumes = 200 # Limit number of Volumes in Pool
Recycle Oldest Volume = yes
RecyclePool = Scratch
}
I used to have Volume Retention set to 35 days before, I changed that
recently. Today, I checked in the PostgreSQL database:
bacula=# select volumename, pool.name, volstatus, media.enabled,
media.recycle, media.actiononpurge, media.volretention from media
bacula-# left join pool using(poolid)
bacula-# where pool.name='POL-35D';
volumename | name | volstatus | enabled | recycle | actiononpurge
| volretention
+-+---+-+-+---+--
Vol0083 | POL-35D | Full | 1 | 1 | 1
| 6048000
Vol0053 | POL-35D | Full | 1 | 1 | 1
| 6048000
[...]
Vol0036 | POL-35D | Append | 1 | 1 | 0
| 6048000
[...]
Vol0054 | POL-35D | Full | 1 | 1 | 1
| 6048000
(54 lignes)
Any volume in the pool has the same volretention : 70 days.
Here is the schedule I use:
Schedule {
Name = "WeeklyCycle"
Run = Full 1st sat at 22:05
Run = Differential 2nd-5th sat at 22:05
Run = Incremental sun-fri at 22:05
}
The problem is the following: The full backup is pruned too quickly.
To restore a 30 days old, sometimes, I need a full older than 30 days
(to use the differential then the incremental I need)
Here is what I have for a specific client:
bacula=# select job, type, level, starttime, jobtdate from job
bacula-# where name='Backup_carina'
bacula-# order by schedtime;
job | type | level | starttime
| jobtdate
--+--+---+-+
Backup_carina.2018-05-20_12.05.00_47 | B | I | 2018-05-20
12:26:00 | 1526812010
Backup_carina.2018-05-21_12.05.00_24 | B | I | 2018-05-21
12:26:30 | 1526898461
Backup_carina.2018-05-22_12.05.00_21 | B | I | 2018-05-22
12:35:49 | 1526985397
Backup_carina.2018-05-23_12.05.00_08 | B | I | 2018-05-23
12:31:07 | 1527071535
Backup_carina.2018-05-24_12.05.00_40 | B | I | 2018-05-24
12:05:02 | 1527156349
Backup_carina.2018-05-25_12.05.00_12 | B | I | 2018-05-25
12:05:02 | 1527242745
Backup_carina.2018-05-26_12.05.00_44 | B | D | 2018-05-26
12:05:03 | 1527329230
Backup_carina.2018-05-27_12.05.00_17 | B | I | 2018-05-27
12:05:03 | 1527415549
Backup_carina.2018-05-28_12.05.00_49 | B | I | 2018-05-28
12:05:03 | 1527501962
Backup_carina.2018-05-29_12.05.00_22 | B | I | 2018-05-29
12:32:24 | 1527589991
Backup_carina.2018-05-30_12.05.00_00 | B | I | 2018-05-30
12:05:02 | 1527674746
Backup_carina.2018-05-31_12.05.00_30 | B | I | 2018-05-31
12:05:03 | 1527761144
Backup_carina.2018-06-01_12.05.00_00 | B | I | 2018-06-01
12:05:02 | 1527847545
Backup_carina.2018-06-02_12.05.00_30 | B | F | 2018-06-02
12:18:09 | 1527935475
Backup_carina.2018-06-03_12.05.00_00 | B | I | 2018-06-03
12:05:02 | 1528020348
Backup_carina.2018-06-04_12.05.00_30 | B | I | 2018-06-04
12:05:02 | 1528106747
Backup_carina.2018-06-05_12.05.00_34 | B | I | 2018-06-05
12:15:52 | 1528193799
[...]
The full backup worked fine at beginning of June. But the May's full
backup has been pruned. I can not restore data pieces from backups
prior to 2 of June. I would need at least one full and one
differential to: have something working.
I am wrong somewhere but I can't identify what I did wrong.
Do you have some things I could investigate to identify why my full
backups are pruned too quickly ?
Kind regards.
Jérôme Blion.
Hello,
It's me again.
Re: [Bacula-users] Need to get Bacula going again ... 1 month with no backups
Le 29/06/2018 à 15:26, Bill Damage via Bacula-users a écrit : Hi, hope this is easy. I was holding back until a regular bacula update came into my Fedora 29 system with a DNF update, and it did yesterday. I'm now on 9.0.8. However, it still thinks I'm using Postgeres, when in fact that's not even installed on the server, it's just mariadb which worked perfectly with F28 and earlier. So I went nuclear and after preserving all my configs and db's did a dnf remove on all the bacula components, then a dnf install on them again. I still get the same problem: [root@tiger ~]# bacula-dir -t bacula-dir: dird.c:1165-0 Could not open Catalog "MyCatalog", database "bacula". bacula-dir: dird.c:1170-0 postgresql.c:332 Unable to connect to PostgreSQL server. Database=bacula User=bacula Possible causes: SQL server not running; password incorrect; max_connections exceeded. 29-Jun 14:21 bacula-dir ERROR TERMINATION Please correct configuration file: bacula-dir.conf So now it seems I need to do something right after a clean DNF install on F29 which I never needed to before and don't know what it is? Is there some setting in bacula.conf I've missed, or are we back to getting the right link to the libbaccs.so as discussed elsewhere? I don't mind if its a kludge, I just cant go on longer with no backups. Thanks! Hello, If your catalog is in a mariadb database, it's possible that your bacula-dir.conf has been overwritten by a default one. Did you check that? HTH. Jérôme. -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Full jobs pruned before differential / incremental retention
Hello everyone,
I have a Bacula 7.4.4 installed on a Debian Stretch. I set it up when it
was a 5.2.6 version. I want to have a 35 days retention for "flat
files". I set File retention and Job retention to 35 days on each client
declared.
Client {
Name = ...-fd
Address = ...
FDPort = 9102
Catalog = Catalog1
Password = "..." # password for FileDaemon
File Retention = 35 days # 1 Month
Job Retention = 35 days # 1 Month
AutoPrune = yes # Prune expired Jobs/Files
Maximum Concurrent Jobs = 20
}
To restore a 30 days old file, I need at least one full backup that may
be older than 30 days. To keep 2 full backup, I set up volume Retention
to 70 days:
Pool {
Name = POL-35D
Pool Type = Backup
Recycle = yes # Bacula can automatically recycle Volumes
LabelFormat = "Vol"
AutoPrune = yes # Prune expired volumes
Volume Retention = 70 days # one month
Maximum Volume Bytes = 50G # Limit Volume size to something
reasonable
Maximum Volumes = 200 # Limit number of Volumes in Pool
Recycle Oldest Volume = yes
RecyclePool = Scratch
}
I used to have Volume Retention set to 35 days before, I changed that
recently. Today, I checked in the PostgreSQL database:
bacula=# select volumename, pool.name, volstatus, media.enabled,
media.recycle, media.actiononpurge, media.volretention from media
bacula-# left join pool using(poolid)
bacula-# where pool.name='POL-35D';
volumename | name | volstatus | enabled | recycle | actiononpurge |
volretention
+-+---+-+-+---+--
Vol0083| POL-35D | Full | 1 | 1 | 1 |
6048000
Vol0053| POL-35D | Full | 1 | 1 | 1 |
6048000
[...]
Vol0036| POL-35D | Append| 1 | 1 | 0 |
6048000
[...]
Vol0054| POL-35D | Full | 1 | 1 | 1 |
6048000
(54 lignes)
Any volume in the pool has the same volretention : 70 days.
Here is the schedule I use:
Schedule {
Name = "WeeklyCycle"
Run = Full 1st sat at 22:05
Run = Differential 2nd-5th sat at 22:05
Run = Incremental sun-fri at 22:05
}
The problem is the following: The full backup is pruned too quickly.
To restore a 30 days old, sometimes, I need a full older than 30 days
(to use the differential then the incremental I need)
Here is what I have for a specific client:
bacula=# select job, type, level, starttime, jobtdate from job
bacula-# where name='Backup_carina'
bacula-# order by schedtime;
job | type | level | starttime
| jobtdate
--+--+---+-+
Backup_carina.2018-05-20_12.05.00_47 | B | I | 2018-05-20
12:26:00 | 1526812010
Backup_carina.2018-05-21_12.05.00_24 | B | I | 2018-05-21
12:26:30 | 1526898461
Backup_carina.2018-05-22_12.05.00_21 | B | I | 2018-05-22
12:35:49 | 1526985397
Backup_carina.2018-05-23_12.05.00_08 | B | I | 2018-05-23
12:31:07 | 1527071535
Backup_carina.2018-05-24_12.05.00_40 | B | I | 2018-05-24
12:05:02 | 1527156349
Backup_carina.2018-05-25_12.05.00_12 | B | I | 2018-05-25
12:05:02 | 1527242745
Backup_carina.2018-05-26_12.05.00_44 | B | D | 2018-05-26
12:05:03 | 1527329230
Backup_carina.2018-05-27_12.05.00_17 | B | I | 2018-05-27
12:05:03 | 1527415549
Backup_carina.2018-05-28_12.05.00_49 | B | I | 2018-05-28
12:05:03 | 1527501962
Backup_carina.2018-05-29_12.05.00_22 | B | I | 2018-05-29
12:32:24 | 1527589991
Backup_carina.2018-05-30_12.05.00_00 | B | I | 2018-05-30
12:05:02 | 1527674746
Backup_carina.2018-05-31_12.05.00_30 | B | I | 2018-05-31
12:05:03 | 1527761144
Backup_carina.2018-06-01_12.05.00_00 | B | I | 2018-06-01
12:05:02 | 1527847545
Backup_carina.2018-06-02_12.05.00_30 | B | F | 2018-06-02
12:18:09 | 1527935475
Backup_carina.2018-06-03_12.05.00_00 | B | I | 2018-06-03
12:05:02 | 1528020348
Backup_carina.2018-06-04_12.05.00_30 | B | I | 2018-06-04
12:05:02 | 1528106747
Backup_carina.2018-06-05_12.05.00_34 | B | I | 2018-06-05
12:15:52 | 1528193799
[...]
The full backup worked fine at beginning of June. But the May's full
backup has been pruned. I can not restore data pieces from backups prior
to 2 of June. I would need at least one full and one differential to:
have something working.
I am wrong somewhere but I can't identify what I did wrong.
Do you have some things I could investigate to identify why my full
backups are pruned too quickly ?
Kind regards.
Jérôme Blion.
--
Ch
Re: [Bacula-users] Statistics for bacula backups
Le 04/03/2014 15:42, Jeff MacDonald a écrit : > Hi, > > I’m curious if there is anywhere out there that has a list of common queries > to run against the database to gather stats? > > Or if this is a page we’d be interested in maintaining in the wiki. > > Some stats I can think of might be > > - space consumed on average per day, per week , per month. > - average volumes per full backup of all jobs. > > Mostly volume usage related ones are helpful to me. > > Jeff. > > Hello, Bacula-web and webacula provides some statistics. For me, this is incomplete, as I would need some parameters fields. Best regards. Jerome Blion. -- Subversion Kills Productivity. Get off Subversion & Make the Move to Perforce. With Perforce, you get hassle-free workflows. Merge that actually works. Faster operations. Version large binaries. Built-in WAN optimization and the freedom to use Git, Perforce or both. Make the move to Perforce. http://pubads.g.doubleclick.net/gampad/clk?id=122218951&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Advise needed on Bacula version
Le 03/03/2014 20:14, Huub Van Niekerk a écrit : On Monday, March 3, 2014 7:44 PM, Jérôme Blion wrote: Le 03/03/2014 16:53, Huub Van Niekerk a écrit : On , Huub Van Niekerk <mailto:huubvanniek...@yahoo.com> wrote: On Monday, March 3, 2014 3:28 PM, Jérôme Blion <mailto:jerome.bl...@free.fr> wrote: Le 2014-03-03 14:22, Huub Van Niekerk a écrit : > As root, "ldd libbacsql", "ldd libbacsql*" and "ldd *libbacsql*" all > tell No such file or directory. > > Regards, > hvn >Hello, >On my boxes, libbacsql are in /usr/lib/bacula. >You will have to find the module first ;) >HTH. >Jerome Blion Oops my bad...ok. ldd gives: linux-gate.so.1 => libstdc++.so.6 => /usr/X11R6/lib/libstdc++.so.6 libm.so.6 => /lib/libm.so.6 libc.so.6 => /lib/libc.so.6 libgcc_s.so.1 => /usr/X11R6/libgcc_s.so.1 /lib/ld-linux.so.2 Regards, hvn Correction: libstdc++ starts on a new line... >Hello, >ldd /usr/sbin/bacula-dir ? >Seems that the library exists and is OK. >How did you install Bacula ? >HTH. >Jérôme Blion. As I couldnt find an installer for Slackware I installed from source in /opt. But since the library is somewhere else...the installation likely went wrong. Hello, You can probably fix that quite easily. You could certainly add modules paths into /etc/ld.so.conf, /etc/ld.so.conf.d or something like that resolve dependencies the nice way. HTH. Best regards. Jerome Blion. -- Subversion Kills Productivity. Get off Subversion & Make the Move to Perforce. With Perforce, you get hassle-free workflows. Merge that actually works. Faster operations. Version large binaries. Built-in WAN optimization and the freedom to use Git, Perforce or both. Make the move to Perforce. http://pubads.g.doubleclick.net/gampad/clk?id=122218951&iu=/4140/ostg.clktrk___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Advise needed on Bacula version
Le 03/03/2014 16:53, Huub Van Niekerk a écrit : On , Huub Van Niekerk wrote: On Monday, March 3, 2014 3:28 PM, Jérôme Blion wrote: Le 2014-03-03 14:22, Huub Van Niekerk a écrit : > As root, "ldd libbacsql", "ldd libbacsql*" and "ldd *libbacsql*" all > tell No such file or directory. > > Regards, > hvn >Hello, >On my boxes, libbacsql are in /usr/lib/bacula. >You will have to find the module first ;) >HTH. >Jerome Blion Oops my bad...ok. ldd gives: linux-gate.so.1 => libstdc++.so.6 => /usr/X11R6/lib/libstdc++.so.6 libm.so.6 => /lib/libm.so.6 libc.so.6 => /lib/libc.so.6 libgcc_s.so.1 => /usr/X11R6/libgcc_s.so.1 /lib/ld-linux.so.2 Regards, hvn Correction: libstdc++ starts on a new line... Hello, ldd /usr/sbin/bacula-dir ? Seems that the library exists and is OK. How did you install Bacula ? HTH. Jérôme Blion. -- Subversion Kills Productivity. Get off Subversion & Make the Move to Perforce. With Perforce, you get hassle-free workflows. Merge that actually works. Faster operations. Version large binaries. Built-in WAN optimization and the freedom to use Git, Perforce or both. Make the move to Perforce. http://pubads.g.doubleclick.net/gampad/clk?id=122218951&iu=/4140/ostg.clktrk___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Advise needed on Bacula version
Le 2014-03-03 14:22, Huub Van Niekerk a écrit : > As root, "ldd libbacsql", "ldd libbacsql*" and "ldd *libbacsql*" all > tell No such file or directory. > > Regards, > hvn Hello, On my boxes, libbacsql are in /usr/lib/bacula. You will have to find the module first ;) HTH. Jerome Blion -- Subversion Kills Productivity. Get off Subversion & Make the Move to Perforce. With Perforce, you get hassle-free workflows. Merge that actually works. Faster operations. Version large binaries. Built-in WAN optimization and the freedom to use Git, Perforce or both. Make the move to Perforce. http://pubads.g.doubleclick.net/gampad/clk?id=122218951&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Advise needed on Bacula version
Le 2014-03-03 11:03, Huub Van Niekerk a écrit : > On Monday, March 3, 2014 10:56 AM, Huub Van Niekerk > wrote: > > Hi, > >> I have a server running Slackware 12, kernel 2.6.21. So far, I used > first a stripped, free version of commercial software >for the backup > on DDS tapes (external USB). After hardware problems with the > tapedrive, the free version stopped >working and is no longer > available. Then I used a tryout version and sine the money ran out, I > can't renew. As a >replacement I installed Bacula 5.2, but that > doesn't start. Since I assume that is due to the old kernel I'm still > running >(plan is to migrate to CentOS), I would like some advise on > which version of Bacula I can use. > >> Thank you. > >> hvn > > As an addition: I have MySQL 5.0 running. The error message upon > starting Bacula is "error while loading shared libraries: > libbacsql-5.2.13.so: cannot open shared object file: No such file or > directory". This probably is guiding to any given advise. > Hello, What does ldd tells you about that module? Seems some requirements should be missing Best regards. Jerome Blion. -- Subversion Kills Productivity. Get off Subversion & Make the Move to Perforce. With Perforce, you get hassle-free workflows. Merge that actually works. Faster operations. Version large binaries. Built-in WAN optimization and the freedom to use Git, Perforce or both. Make the move to Perforce. http://pubads.g.doubleclick.net/gampad/clk?id=122218951&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Low performance for Proxmox VM backup
Hello, I use Bacula daily and faced no real issues for years. I installed a new instance and am facing a strange issue. I installed a new bacula server under Debian Wheezy. I try and backup several virtual machines hosted on 2 proxmox servers. These proxmox servers use their local hard disks drive (software RAID 1) Most of these VM are quite small and performance is not an issue. For 2 of them, it's not the same deal. They have 200 GB data pieces to back up : - one mail server - one web server Example : 2013-12-08 17:39:51 bck-dir-01-dir JobId 80: Bacula bck-dir-01-dir 5.2.6 (21Feb12): Job:Backup_eagle-vmail_QG.2013-12-08_10.13.18_38 Backup Level: Full (upgraded from Incremental) Client: "eagle-fd" 5.0.1 (24Feb10) i486-pc-linux-gnu,ubuntu,10.04 FileSet:"VMail q-g" 2013-12-08 10:13:18 Pool: "File" (From Job resource) Catalog:"Catalog1" (From Client resource) Storage:"File" (From Job resource) Scheduled time: 08-déc.-2013 10:13:17 Start time: 08-déc.-2013 10:13:20 End time: 08-déc.-2013 17:39:50 Elapsed time: 7 hours 26 mins 30 secs Priority: 15 FD Files Written: 426,533 SD Files Written: 426,533 FD Bytes Written: 79,375,820,932 (79.37 GB) SD Bytes Written: 79,463,703,342 (79.46 GB) Rate: 2962.9 KB/s Software Compression: None VSS:no Encryption: no Accurate: yes All machines have their network link set up to 1Gb/s FD With SCP, I can send / receive files at 50-60MB/s. First I used one job. It was running at something around 3MB/s. I split this job into 5 pieces. The job you can see backs up all mailboxes beginning with Q, S, D, F, G. Each job runs at 3MB/s. So, with 5 jobs running at the same time, I can get 15 MB/s. The backup window has been reduced by 5 and is now acceptable. I disabled "Accurate=yes". no change in the job's duration. I enabled compression : no change in the job's duration. It's not bound by the CPU neither the network. (running more jobs just increases the throughput linearly) With 1 job running at a time, there is no iowait. With 3 jobs at the same time, I have less than 5% iowait What could I check to find where is the bottleneck ? Best regards. Jerome Blion. -- Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into your Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Maximum Concurrent Jobs: sometimes only one job running
Le 2013-11-05 10:20, Hans Schou a écrit : > Hi > > I have configured my system to run 5 jobs at the same time. It works > well > with the the first 5 jobs but then it is a bit on and off. > > At the gant chart below show the 5 jobs starting a Full backup 1st > november > 22:05. Client asrv0 runs for 6 hours 11 minutes but in the time > between bsrv2 > ends and bsrv5 starts only one job is running. > > I did expect to always see at least 5 '#' marks vertically. > > It seems like the director starts 5 jobs and when all of them are > done, it > starts the 5 next jobs. I expected that as long as the 'Priority' of > all the > jobs are the same then a new job would be started when one is done. > > 1 asrv0 01 22:05 # asrv0 06:11 > 2 bsrv1 01 22:05 # bsrv1 00:00 > 3 bsrv2 01 22:05 ### bsrv2 03:04 > 4 asrv3 01 22:14 ### asrv3 01:25 > 5 bsrv4 01 22:14 # bsrv4 02:27 > 6 bsrv5 02 03:49 ---## bsrv5 00:38 > 7 bsrv6 02 03:51 --- bsrv6 01:32 > 8 bsrv7 02 04:09 ### bsrv7 03:09 > 9 bsrv8 02 04:18 bsrv8 01:53 > 10 tsrv9 02 04:30 -## tsrv9 06:32 > 11 csrv10 02 07:08 --# csrv10 00:01 > 12 csrv11 02 07:08 --# csrv11 00:13 > 13 csrv12 02 07:11 -- csrv12 01:42 > 14 dsrv13 02 07:21 --# dsrv13 02:28 > 15 csrv14 02 07:34 --- csrv14 05:57 > 16 dsrv15 02 13:18 > --### > > Bacula version 5.0.2 > > Any help much appreciated. > > (Before you ask: The gant chart is from a QND perl script) > > -- > Venlig hilsen > Hans Schou Hello, Do you use File tapes ? I noticed that when a file tape is full, pending jobs do not start concurrently anymore. Best regards. Jerome Blion. -- November Webinars for C, C++, Fortran Developers Accelerate application performance with scalable programming models. Explore techniques for threading, error checking, porting, and tuning. Get the most from the latest Intel processors and coprocessors. See abstracts and register http://pubads.g.doubleclick.net/gampad/clk?id=60136231&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] choosing database.
Le 2013-10-04 14:25, Dan Langille a écrit : > On 2013-09-19 11:06, Mauro wrote: >> Hello. >> I'm using bacula in a linux debian system. >> >> I've to backup about 30 hosts. >> I've choose postresql as database. >> What do you think about? >> Better mysql or postgres? > > I recommend PostgreSQL. > > As the author of the PostgreSQL database layer, this recommendation is > clearly biased. The main consideration is the number of files backed up. Their size does not matter. On a MySQL Bacula server, I noticed a performance slowdown if the catalog is not cleaned regularly. I perform a dbcheck weekly to be sure my catalog is clean (it's a good solution to manage its size) Hope this helps. Jerome Blion -- October Webinars: Code for Performance Free Intel webinars can help you accelerate application performance. Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from the latest Intel processors and coprocessors. See abstracts and register > http://pubads.g.doubleclick.net/gampad/clk?id=60134791&iu=/4140/ostg.clktrk ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula security
Le 2013-07-01 17:07, Martin Simmons a écrit : >> It can be secured via ACL too. >> You can manage what a client has access to. >> >> And so, ensure no critical data pieces can be stolen through that >> way. > > Yes, that works as long as the Director is secure -- otherwise the > attacker > can just write their own ACL. > > __Martin Hello, Obviously, if you can't trust your director anymore, you can consider all your clients AND YOUR DATA PIECES are not safe anymore. So, to harden the infrastructure : - secure the director at any cost - secure the console access from clients (FD) (ACL, or easiest, no console access) To speak about storage daemon, you have to be sure that even in the case data files could be retrieved, nobody will be able to read them. That means that if you are paranoïd, your tapes (physical or virtual) have to be crypted. HTH. Jerome Blion -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula security
Le 2013-07-01 15:53, Martin Simmons a écrit : >>>>>> On Mon, 01 Jul 2013 15:25:23 +0200, Jérôme Blion said: >> >> Le 2013-07-01 13:07, Martin Simmons a écrit : >>> Bacula does have root read (and write) privileges on every backed-up >>> system, >>> but you can encrypt the backups before sending them to the central >>> server. >>> Bacula can also sign the backups, so the client can verify that a >>> restore >>> doesn't contain modified data. You still have to keep the >>> encryption/signing >>> keys secure of course. >>> >>> __Martin >> >> >> If the bacula server is compromised and the attacker gains root >> privileges on the Bacula director, it can modify any client's job to >> run >> a specific command to gain access (unprivileged or not) >> In this kind of architecture, securing the director from unauthorized >> access is primordial and needs to take the necessary time to do it >> properly. >> >> If you don't grant privileges to clients (console access and so on), >> they can be safely compromised (sigh). At worst, you will back up >> wrong >> files. If they have a console access to the director, you must ensure >> they can't do harm to your system or your files (restoring files from >> a >> confidential system on a public one, for example) > > The latter case is secured by encrypting the backups (since the key is > only on > the correct client). > > You are right are the risk of compromise of the client though -- it > looks like > there is no way to force the FD to only restore from signed backups. > > __Martin Hello, It can be secured via ACL too. You can manage what a client has access to. And so, ensure no critical data pieces can be stolen through that way. HTH. Jerome Blion. -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula security
Le 2013-07-01 13:07, Martin Simmons a écrit : > Bacula does have root read (and write) privileges on every backed-up > system, > but you can encrypt the backups before sending them to the central > server. > Bacula can also sign the backups, so the client can verify that a > restore > doesn't contain modified data. You still have to keep the > encryption/signing > keys secure of course. > > __Martin If the bacula server is compromised and the attacker gains root privileges on the Bacula director, it can modify any client's job to run a specific command to gain access (unprivileged or not) In this kind of architecture, securing the director from unauthorized access is primordial and needs to take the necessary time to do it properly. If you don't grant privileges to clients (console access and so on), they can be safely compromised (sigh). At worst, you will back up wrong files. If they have a console access to the director, you must ensure they can't do harm to your system or your files (restoring files from a confidential system on a public one, for example) HTH. Jerome Blion. -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Is there any interest in a new Bacula reporting system?
Le 2013-06-28 02:13, Kenneth Stauch a écrit : [... SNIP ... ] Hello, I have one important need I can't manage through webacula and bacula-web. bacula-web has some interesting reports, but it's not possible to tune them on the fly. For example, I would like to be able to change the timeframe of these reports or select several clients at a time. If we can create reports through the interface, it's more than perfect, I would be happy to test it. What are the requirements of the tool you developped? HTH. Jerome Blion. -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Too much files to save in catalog - MysQL performance tips.
Le 17/06/2013 19:03, Luis H. Forchesatto a écrit : > Greetings. > > I'd like to discuss my situation here where I have a job who backups > only 200GB in files, but it has 2 million more files to save on > catalog (MySQL). When the file copy is complete the storage server, > who also runs the director, spend many hours to save the files in the > catalog. This also cause low mysqld performance at all. > > Is there any tip to optimize the catalog operation or MySQL > performance to make the job less resource hungry? > > The job runs once a week with no concurrent jobs. Director and storage > runs at the same computer but the client is another server, at the > same network who can transport up to 1Gb of data between the servers. > > Any tips will be apretiated. > > Hello, InnoDB ? MyISAM ? tuning-primer.sh + mysqltuner.pl please... Best regards. Jerome Blion. -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] MySQLdump import seems very slow for "Filename" and "Path" tables
Le 16/03/2013 10:54, Uwe Schuerkamp a écrit : > My question: Is there some way to optimize the catalog dump to make > the import faster, like maybe omitting indices and re-creating them > manually once the import has completed? Seeing the Path table also has > 19GB, its import probably won't have finished before our Sun goes > Nova. ;) > Hello, You have several ways to speed it up. First: - use --disable-keys when dumping - use other tools to do the backup / restore : You can try: * mydumper : Each table will be a different dump. you will recreate the database using multiple threads in parallel. * mylvmbackup : you will restore a snapshot of the filesystem, the speed will be the highest you can have. (the size of the backup will be much bigger) Do you clean regularly your catalog with dbcheck? HTH. Jerome Blion. -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Manage disk space used by Bacula
Le 2013-03-07 22:53, artakami a écrit : > Hi > I am currently using Bacula 5.2.12 and I am having problem with > controlling disk space. > It seems like bacula does not overwrite old data in backup files > until it fills up whole disk space. > > I would like to know if anybody else had/having same problem and how > did they get over it? > The best way to control space used by Bacula I found is to set up : - volume maximum size - volume count to a fixed value This way, you know how much space a pool can use. Because I don't need several ones, it was even easier... Disk space needed : volume count x max volume size. HTH. Jérôme Blion. -- Symantec Endpoint Protection 12 positioned as A LEADER in The Forrester Wave(TM): Endpoint Security, Q1 2013 and "remains a good choice" in the endpoint security space. For insight on selecting the right partner to tackle endpoint security challenges, access the full report. http://p.sf.net/sfu/symantec-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Two servers one ... robot?
Le 27/02/2013 23:58, etanneh...@godaddy.com a écrit : I am looking to see if it is possible to run two storage directors both talking to the same robotic library? Does anyone have first hand experience with this Hello, Last time I did it on a TS3584, I partitioned the physical library to create 3 logical libraries. HTH. Jerome Blion. -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_feb___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Migrating from myisam to innodb
Hello, > key_buffer = 1G > innodb_file_per_table > innodb_flush_method=O_DIRECT > innodb_flush_log_at_trx_commit=2 > innodb_buffer_pool_size=12G > innodb_log_buffer_size=4M > innodb_thread_concurrency=8 You can tune innodb_log_file_size. Beware, you have to shut mysql down correctly and move redo files to recreate new ones. What is the format of the tables ? COMPRESSED ? COMPACT ? (you can see it in INFORMATION_SCHEMA) > We'll now do some further testing to see if dump speed has improved > and how writing during backups and volume expiry performs. Dumping a table is fast. Reimporting it is VERY slow. For big databases, I use mylvmbackup to perform LVM snapshots. > The File table space has grown from 160GB in MyISAM to a whopping > 294GB on InnoDB, what could be the reason for this apart from the > indices now being stored within the IBD file? Index size was around > 40G on MyISAM before. InnoDB needs more space by design. Space freed in the table is never freed on filesystem. I advise you to run dbcheck periodically to control the database's size. > I hope you find this information useful in planning / sizing your own > myisam -> innodb migration if you haven't already done so. I'd also > be > grateful if you'd point out any obvious flaws or improvments to the > settings noted above. I wonder if dumping the file table and then > re-importing it to an innodb replacement would have been quicker? > Time > for more testing I guess ;) Usually, it's faster to dump / reimport. It would anyway took dozens of hours... Hope this helps. Jerome Blion. -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_feb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] backup concurrency
Le 2013-02-20 10:19, Antony Mayi a écrit : > Hi community, > > I am running backups of multiple database servers and each backup job > is defined with "RunScript" command that dumps the databases on each > particular server and these dumps are then taken for backups. > > The dumps take different times on each server - minutes to couple of > hours. Since the dumping doesn't involve bacula storage daemon I want > another jobs to be running in parallel that can be sending data to > storage while the db servers are dumping the databases. Also the > database dumps can be running in parallel instead of sequentially as > that's purely local matter. > > I've increased the "Maximum Concurrent Jobs" in "Director" resource > but I can still see only one job running at a time. I don't think I > want to increase this as well in "Storage" resource and definitely > not > in the "Job" resource. > > What am I missing here? > > ...running bacula 5.2 > > thx, > Antony. Hello, What is the state of the other jobs while one is running? How did you set up your Maximum Concurrent jobs? HTH. Jerome Blion. -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_feb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Install and configure both server and client
Le 2013-02-07 04:28, Jake G. a écrit : > Ok after getting bacula working I can honestly say it the worst > backup solution I have ever used. > > Thanks everyone for your help! Hello, Could you please detail a little bit more why it's the worst tool you ever used ? Which backup solution do you use ? Best regards. Jerome Blion. -- Free Next-Gen Firewall Hardware Offer Buy your Sophos next-gen firewall before the end March 2013 and get the hardware for free! Learn more. http://p.sf.net/sfu/sophos-d2d-feb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Install and configure both server and client
Hello, Before installing Bacula, you have to design your backup infrastructure. To design your backup infrastructure, you have to know what you want to do with it and how to do it. There are 3 major parts : - File Daemon : It's the client. You have to install it on each machine you want to backup. - Storage Daemon : It's the server which will manage volumes you will backup data pieces to. - Director : It's the scheduler and manager of the solution. To backup something, you have to define: - what you want to secure (Filesets) - when you want to secure it (Schedules) - how long you want to secure it (Retention periods) - ... Once you will have all these parameters, you will be able to merge them into a JobDefs... and then create Jobs for each machine you want to backup. To store it, you have to define your volume management strategy : - Tape / Disk (each one has its own constraints) - Offsite copy - Recycling policy - ... You understood why there is no standard documentation. There is no standard installation ! I provided you several keywords which will help you to dig into the Bacula manual and build you backup strategy. Have a good week reading the manual ;-) Jérôme Blion. -- Free Next-Gen Firewall Hardware Offer Buy your Sophos next-gen firewall before the end March 2013 and get the hardware for free! Learn more. http://p.sf.net/sfu/sophos-d2d-feb ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Tune MySQL, or switch to pgsql?
Le 01/02/2013 20:48, Alan McKay a écrit : > OK, I know some of you guys are biased here because I recognise some > of the names from my pgsql days :-) > > I've been googling to find MySQL tuning instructions for bacula but > not much is coming up. Though I did find a 2 or 3 year old > discussion from this list which suggested I'd get better performance > from pgsql anyway.I certainly don't know pgsql as well as MySQL, > but I did used to know a fair bit about it and switching would not be > that big a deal to me. > > So what do you think? > > Anyone have any specific links for MySQL + Bacula tuning? > Anyone have any datapoints on MySQL vs pgsql for Bacula? > > Will pgsql still have to be tuned? > > thanks, > -Alan Hello, You can use tuning-primer and mysqltuner.pl to adjust some buffers. On my database, there is ONE message which will indicate what to do: [--] Reads / Writes: 1% / 99% That means that you have to focus on the write capability. To do it, I do it that way: - Use 5.1+ MySQL Version. - Use Barracuda InnoDB engine (that means using InnoDB plugin on 5.1 version, on 5.5, it's automatic) for all Bacula tables. - Size innodb_*_buffer_* to handle the night. I noticed that cleaning the database (using dbcheck) helps to control the database size and thus stabilize the performance. I do it on a weekly basis with a cron job: /usr/bin/yes yes | /usr/sbin/dbcheck -c /etc/bacula/bacula-dir.conf -C Catalog1 -b -f Hope this helps. Jerome Blion. -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_jan ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula - how to install only storage daemon
Le 28/01/2013 10:01, rout a écrit : > Good Morning everybody, > > I`m a SysAdmin from Germany. My English is not very good so I hope you can > understand me. > > I´m testing Bacula to install at our scientific linux servers - and now I > want to install on a 2nd server only the storage-daemon. > > I want to run the configure script but I can´t see the right option for only > installing daemon storage. > > How can I configure/compile/install only the storage daemon on the server? > > Greetings > > Wolfgang > Hello, Did you try to install it through the packaging system of your operating system? Best regards. Jerome Blion. -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Should I add /etc/bacula to the "Catalog" backup?
Le 25/01/2013 20:09, John Drescher a écrit : >> And further, before creating the file in the first place it removes >> one that may already be there, by the looks of it. >> >> Just making sure I got that right. Is there a reason not to leave the >> file there until next time? Just a space issue? > Just a space issue. Remember that depending on how many files you have > the dump can grow. My database is over 30 GB. > > John Hello, If you don't have the space needed to store the dump, you won't have the space to perform the dump ! I'd rather not delete it as I don't want anyone on the server to believe there is too much free space on it. I do the same thing on servers where dumping a database is needed. That space is not really free, so I prefer and use it that letting other users crash my backup jobs by filling disks. Just my personal way to ensure I have enough space to perform my database backups... Jerome Blion -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula Query
Le 2013-01-24 08:37, krishna pawankar a écrit : > Hi All, > > I want to install bacula 5.2.6 for taking backup on HDD and not on > tapes. > What are things i should need to take care since what i know about > bacula is we can only use tapes or VTLs for taking backups. > Now there is no autochanger since i am not using tapes here. > Please provide your guidance. > Thanks in advance. > > Thanks, > Krishnasai Bacula can perform backups on disks. Just define the good pool. You can write directly to disk or use vchanger to emulate an autochanger. HTH. Jerome Blion. -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Reporting on previous jobs
Le 2013-01-16 20:33, Jack Cobb a écrit : > We are using Bacula 5.0.3 on an Ubuntu 10.04 server using MySQL as > the database engine. We review each day's backup to verify it > completed but now our auditors are asking for a report that shows the > backup job results for the previous twelve months...which is the > amount of time we keep our backup history. > > Has anyone ever generated a report using the Bacula history and if so > what tools did you use? Thanks. > > Jack Cobb > > MIS Department > > Skyline Corporation > > 574.294.6521 x.362 > > jc...@skylinecorp.com Hello, I think you should have a look on reportula, webacula, bacula-web. They can help you to get the data pieces you will have to provide to auditors. Good luck (I had to do it for SOX Compliancy) HTH/ Jérôme Blion. -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnmore_122712 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] restore performance
Le 2013-01-14 14:32, Uwe Schuerkamp a écrit : > On Mon, Jan 14, 2013 at 08:24:07AM -0500, John Drescher wrote: >> > I just ran into this. After a Google search, I turned up an >> article that >> > says the indices that used to make Bacula run faster now cause a >> performance >> > problem with recent versions of Bacula and recent versions of >> MySQL (it's on >> > the Bacula wiki, the address for which I don't have handy). I >> removed all of >> > the indices I had on the file table and restores only take a few >> minutes >> > now. >> >> Even though you have a tiny database I would still look into tuning >> your mysql settings. A lot of distributions ship with a ridiculous >> default configuration that assumes your PC has 64MB of ram or >> similar. >> >> John >> > > I'd like to have the above point clarified by the people in the know: > Are File table indices recommended with bacula versions > 5.0 or > not? > Can the original poster provide a link to the article mentioned > above? > > Thanks, Uwe > > -- > NIONEX --- Ein Unternehmen der Bertelsmann SE & Co. KGaA Hello, Did you have a look on that? http://wiki.bacula.org/doku.php?id=faq#restore_takes_a_long_time_to_retrieve_sql_results_from_catalog dbcheck creates 2 indexes. If interrupted, these two indexes can have a very big impact on times to perform actions related to these tables (backup AND restores) Your catalog is quite small, anyway, did you schedule to run a dbckeck periodically? Best regards. Jerome Blion. -- Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122412 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL - how to exclude bacula database?
Le 2012-12-28 11:19, lst_ho...@kwsoft.de a écrit : > Zitat von Dan Langille : > >> On Dec 27, 2012, at 8:40 PM, Jérôme Blion wrote: >> >>> You can use pg_dump to backup databases separately. (as far as I >>> know, >>> the pg_dump creates consistent backup by defaults, whereas >>> mysqldump >>> does not by default) >> >> >> Say what? mysqldump doesn't produce a valid backup? > > Back in ancient times there where problems with some backends doesn't > produce valid *online* backups with mysqldump, but that's a long gone > story as far as i know. > > Regards > > Andreas http://dba.stackexchange.com/questions/6363/consistent-logical-backup-of-databases-that-use-myisam-and-innodb-engines http://dev.mysql.com/doc/refman/5.5/en/mysqldump.html#option_mysqldump_single-transaction And another reason not to use mysqldump on production systems: the nightmare begins when you have to restore a huge dump. http://www.mysqlperformanceblog.com/2010/11/08/an-argument-for-not-using-mysqldump-in-production/ As long as Mysql uses non transactional engines, if you want a consistent backup of all databases, you will have to create an outage during the whole duration of the backup. (that's why I use other tools like mylvmbackup and mydumper when I can afford to loose some records) HTH. Jerome Blion -- Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and much more. Get web development skills now with LearnDevNow - 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts. SALE $99.99 this month only -- learn more at: http://p.sf.net/sfu/learnmore_122812 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] PostgreSQL - how to exclude bacula database?
Hello,
Le 27/12/2012 22:21, Wolfgang Denk a écrit :
> Hi again,
>
> here is another PostgreSQL related question: when backing up the
> database server, I would like to exclude the bacula database (which
> gets backed up separately anyway).
>
> With MySQL, I could do this easily with somthing like this:
>
> Options {
>RegexFile = "^/var/lib/mysql/mysql-bin." # exclude MySQL replication
> logs and index
>RegexFile = "^/var/lib/mysql/bacula/" # exclude bacula DB itself -
> backup separately
>RegexFile = "^/var/lib/mysql/ib"
>Exclude = yes
> }
To back up MySQL datadir, you should issue a FLUSH TABLES WITH READ
LOCK, or you may have inconsistencies.
This will happen on databases which will move during the backup.
If you don't do that, you can loose data pieces.
> However, none of the PostgreSQL based examples I have seen so far
> contain similar (at least similar obvious) exclude rules. What am I
> missing here?
If you want to back up datafiles directly, you have to issue a
pg_start_backup() and a pg_end_backup() to be sure your backup is
consistent.
If you don't do that... you can have data loss too.
You can use pg_dump to backup databases separately. (as far as I know,
the pg_dump creates consistent backup by defaults, whereas mysqldump
does not by default)
Hope this helps.
Jerome Blion.
--
Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and
much more. Get web development skills now with LearnDevNow -
350+ hours of step-by-step video tutorials by Microsoft MVPs and experts.
SALE $99.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122812
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Running Client Script
Le 21/12/2012 19:27, Dan Langille a écrit :
> On Dec 21, 2012, at 12:46 PM, Joseph De Nicolo wrote:
>
>> Hey Bacula Users,
>>
>> This should be an easy question for some body with bacula experience.
>>
>> I need to run a script that will backup my web server's mysql database. The
>> script works great, using mysqldump.
>> The web server and backup server are two different dedicated machines, hence
>> the backup system is "off-site".
>> The script needs to run before the backup job obviously, but only on the
>> client, and the job should continue whether its successful or fails.
>> Here is my script:
>>
>> RunScript {
>> Command = "/var/backupmysql.sh"
>> RunsWhen = Before
>> RunsOnFailure = yes
>> RunsOnClient = yes
>> RunsOnSuccess = yes
>>}
>>
>> Now my question is.. should my script(backupmysql.sh) be located on the
>> backup system only, the client only, or both? I'm not sure if bacula takes
>> the script locally and ports it over to the client or if it searches fo the
>> script on the client itself. I hope you understand what I'm talking about.
>> Appreciate the help.
> It can be where ever you can run mysqldump.
>
> I suggest it should be on the same machine as the MySQL server. i.e. the
> client
>
> Also: I suggest not deleting the dumped file after the backup. I suggest
> leaving it there, in case you need it. Faster than doing a restore.
>
> I also suggest copying that file, and all your bacula *.conf files to another
> location, or two, or three. I do that on a daily basis.
Hello,
There is one important reason to keep the backup on the disk...
This space has to be reserved for backup purposes. So, just use it all
the time to avoid and think you can use it for other needs.
My 2 cents.
Jerome Blion.
--
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Subject: Re: Do I have to update
Le 2012-12-19 08:54, Olivier Delestre a écrit : > Hi, > > it works except for complete adding a device. You must then restarts > bacula. > > A+ ;) Hello, I never restarted Bacula Director after having created these two files. (I only restart it when it's going wrong !) A reload into bconsole is enough. The @|... syntax enables dynamic configuration files loading. You have to check messages to see what's wrong with your config. Jérôme Blion. -- LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Do I have to update /etc/bacula/bacula-dir.conf everytime I add a new client, even except ip everything is same, btw is there some sort of template new client could follow?
Le 18/12/2012 08:24, Zhenkai Jiang a écrit :
>
> just curious how to make adding new client work to be automated
> instead of updating conf file manually
Hello,
I don't like to modify bacula-dir.conf.
I added this line in bacula-dir.conf to manage clients easily:
@|"sh -c 'for f in /etc/bacula/clients/*/*.conf; do echo @${f}; done'"
(it's documented into bacula manual)
I created a template with these 2 files:
root@server:/etc/bacula/clients/dev-fd# ll
-rw-r--r-- 1 root root 332 20 juin 2011 client.conf
-rw-r--r-- 1 root root 205 2 juin 2011 jobs.conf
After these two files have been created, I just have to issue a reload
into bconsole and that's all !
It's ONE way. You can create your own.
HTH.
Jerome Blion.
--
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] disaster recovery of the actual bacula server
Le 29/11/2012 21:58, Dan Langille a écrit : On Nov 29, 2012, at 10:30 AM, Jonathan Horne wrote: I am getting ready to deploy my first bacula server to our production environment. I would like to practice 2 scenarios of recovery. First, I will recover the configuration files and mysql database (from dump files), and hopefully continue on. The second, I will recover only the configuration files. Both scenarios, will tear down the server and rebuild new OS and reattach the LUN where the volume pools are stored. The first seems pretty straight forward, especially is the mysqldump is current after the most recent backups that ran. The 2^nd , poses the question of how to import existing volume pool data into a new bacula director installation? Any advice or acedotes from when this has been previously performed would be appreciated. Every day: - copy your Catalog dump (i.e. a text file) to another location - copy your *.conf files to the same location At that location, use log rotate to keep N copies of those files sitting around. I do the above to three different locations: one on-site, two off-site. -- Dan Langille - http://langille.org Hello, I used Netbackup for years. When I used it, the catalog was not a real database, and had to be backed up with Netbackup tools. To secure the current version, we had a 3-part mirror on 2 remote SAN + local disks. As Bacula stores most data pieces in text files or in a mainstream database, you can do everything you can imagine on databases: 1 - For mysql databases, just forget mysqldump. As soon as your database will grow, restore from a dump will become longer and longer. I use mylvmbackup on databases which are modified all the times (huge environments). For quieter databases, I use mydumper. Of course, you have to keep several versions of this backup (as you already do for every thing else, isn't it ? ;-) ) 2 - Enable binary logging and export binary logs to another server often. Hourly is a good start. If you can, you can even imagine to store binary logs on a remote filesystem. This way, you always have the latest version of binary logs on another server. 3 - You can imagine to use a MySQL slave to ensure you have at least 2 versions of the same catalog at the same time. In case of crash, you won't loose your catalog. 3 does not replace 1 and 2 as a slave is "just" a snapshot. If the database is corrupted, it will be on both servers and you will have to recover it from backups. HTH. Jerome Blion. -- Keep yourself connected to Go Parallel: TUNE You got it built. Now make it sing. Tune shows you how. http://goparallel.sourceforge.net___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] disaster recovery of the actual bacula server
Le 29/11/2012 17:32, lst_ho...@kwsoft.de a écrit : > Zitat von Jonathan Horne : > >> I am getting ready to deploy my first bacula server to our >> production environment. I would like to practice 2 scenarios of >> recovery. First, I will recover the configuration files and mysql >> database (from dump files), and hopefully continue on. The second, >> I will recover only the configuration files. Both scenarios, will >> tear down the server and rebuild new OS and reattach the LUN where >> the volume pools are stored. >> >> The first seems pretty straight forward, especially is the mysqldump >> is current after the most recent backups that ran. The 2nd, poses >> the question of how to import existing volume pool data into a new >> bacula director installation? > You need the "bscan" utility to rebuild the catalog from your backup volumes: > > http://www.bacula.org/5.2.x-manuals/en/utility/utility/Volume_Utility_Tools.html#SECTION0027 > > Regards > > Andreas As the Bacula catalog is a mainstream database, you can secure it using different ways: - replication (on another site would be the best) - full backup + binlog backup on another site With these two strategies, you wil be able to survive anything. The cost to secure the catalog is so low everyone should do it ;) HTH. Jerome Blion. -- Keep yourself connected to Go Parallel: VERIFY Test and improve your parallel project with help from experts and peers. http://goparallel.sourceforge.net ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Catastrophic error. Cannot write overflow block to device
Hello, ERR=No space left on device You have to make some space... HTH. Jerome Blion Le 2012-11-28 08:16, Luca Bertoncello a écrit : > Hello, list! > > Since 3 days I cannot backup my server... > I always get this error: > > 28-Nov 00:40 skynet-sd JobId 36: Fatal error: device.c:192 > Catastrophic > error. Cannot write overflow block to device > "sata-changer-drive-0" (/var/lib/bacula/changer1/0/drive0). ERR=No > space left on device28-Nov 00:40 skynet-sd JobId 36: Fatal error: > device.c:192 Catastrophic error. Cannot write overflow block to > device > "sata-changer-drive-0" (/var/lib/bacula/changer1/0/drive0). ERR=No > space left on device28-Nov 00:40 skynet-sd JobId 36: Fatal error: > device.c:192 Catastrophic error. Cannot write overflow block to > device > "sata-changer-drive-0" (/var/lib/bacula/changer1/0/drive0). ERR=No > space left on device28-Nov 00:40 skynet-sd JobId 36: Fatal error: > device.c:192 Catastrophic error. Cannot write overflow block to > device > "sata-changer-drive-0" (/var/lib/bacula/changer1/0/drive0). ERR=No > space left on device28-Nov 00:40 skynet-sd JobId 36: Fatal error: > device.c:192 Catastrophic error. Cannot write overflow block to > device > "sata-changer-drive-0" (/var/lib/bacula/changer1/0/drive0). ERR=N > space > left on device28-Nov 00:40 skynet-sd JobId 36: Job write elapsed time > = > 01:39:58, Transfer rate = 15.66 M Bytes/second 28-Nov 00:40 skynet-fd > JobId 36: Fatal error: backup.c:1019 Network send error to SD. > ERR=Connection reset by peer > > I tried to manual purge the volumes, but it didn't help... > What can I do? > > Thanks a lot! > -- > Luca Bertoncello > Programmierer > > FrischerGehts.net GmbH & Co. KG > Schützenplatz 14 > 01067 Dresden > > Tel.: +49(0)351 / 30 70 66 21 > E-Mail: bertonce...@frischergehts.net > > Geschäftsführung: Michael Noack > Handelsregister: Amtsgericht Dresden HRA 8151 > USt.-ID: DE276174185 > > Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte > Informationen. Wenn Sie nicht der richtige Adressat sind oder diese > E-Mail irrtümlich erhalten haben, informieren Sie bitte sofort den > Absender und vernichten Sie diese Mail. Das Kopieren sowie die > Weitergabe dieser E-Mail ist nicht gestattet. > > This E-Mail contains confidential and/or legally protected > information. > If you are not the correct addressee or have received this E-Mail > erroneously, please inform the sender immediately and delete this > mail. > The copying as well as the transmitting of this E-Mail is not > permitted. > > > -- > Keep yourself connected to Go Parallel: > INSIGHTS What's next for parallel hardware, programming and related > areas? > Interviews and blogs by thought leaders keep you ahead of the curve. > http://goparallel.sourceforge.net > > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- Keep yourself connected to Go Parallel: INSIGHTS What's next for parallel hardware, programming and related areas? Interviews and blogs by thought leaders keep you ahead of the curve. http://goparallel.sourceforge.net ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Huge Backups
Hello, Are you sure there is no loop ? Typically, it can happens with onefs=no HTH. Jérôme Blion. Le 22/10/2012 22:33, Mike Seda a écrit : > On 10/22/2012 01:15 PM, John Drescher wrote: >>> I currently have a machine with ~3 GB of data. >>> >>> However, ~230 GB is being backed up by Bacula. >>> >>> I performed a "bconsole -> estimate client=blah listing", and it doesn't >>> look like any files beyond what I specified in the fileset are being >>> backed up. >>> >>> I even set sparse=yes in the fileset options, but it didn't help. >>> >>> Please let me know what I'm missing here. >>> >> Are you sure that 230GB was backed up or are you looking at the size >> of your disk volumes expecting them to reset each backup or something >> like that? > I'm sure that ~230 GB was backed up. It's very strange. > >> John > > -- > Everyone hates slow websites. So do we. > Make your web apps faster with AppDynamics > Download AppDynamics Lite for free today: > http://p.sf.net/sfu/appdyn_sfd2d_oct > ___ > Bacula-users mailing list > Bacula-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/bacula-users -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Is tape filling up too early?
[... snip ...] Did you enabled hardware compression on your tape drive ? Without compression LTO3 is given to fill up to 400 GB. Hope this helps. Jérôme Blion. -- Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_sfd2d_oct ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Running complex commands or scripts remotely on a client
Le 05/09/2012 12:43, Alex Lucas a écrit : > Dears, > > Is there a way to run a complex command or even a script on a client? > > So far I have tried two ways and failed: > 1) when a command (e.g. in "ClientRunBeforeJob") has something like > "echo test > /tmp/test.out" bacula runs it on the client as "echo" as > command and the rest as the argument. i.e. there is no /tmp/test.out on > the client > 2) when I run "test.sh" which is in the PATH on the bacula director it > fails, I guess because there is no identical script on the client. > > Any suggestions? > > > Thank you, > Alex > Hello, "Client Run Before Job" will run a command on the client ! Run Before Job will run on the director. HTH. Jérôme Blion. -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] What happen when a server crash?
Le 22/05/2012 19:33, Martin Simmons a écrit : >>>>>> On Mon, 21 May 2012 15:24:14 -0300, Luis Marcelo Achite said: >> Hi, >> I´m facing a bad situation related with a server crashed. After a power >> outage, my server did not return back and I need to receover a partition >> from a backup. Bacula server is installed on this server, so I dont have >> access to the console to restore the backup. So, my question is: How can >> I recover a backup in a computer that is not working anymore? I suppose >> I need to install again the OS on that server, then install Backup from >> scratch and restore the catalogue. As soon as I have the catalogue >> recovered it will be possible to restore files. Am I correct with this >> thinking? Some of you have a better suggestion for this problem? > Yes, that's correct. You could make the "from scratch" part easier by keeping > a safe copy of Bacula's config files so you don't have to remember how they > were edited from the defaults. You could also keep a copy of the bsr file > created by the catalog backup to make it easier to restore that. > > __Martin > Hello, You should first try to boot on a rescue system (live CD or something like that) to see wether filesystems can be mounted. If they can be mounted, you have a chance to recover configuration files and so be able to restore your bacula quickly. Anyway, I copy /var/lib/bacula and /etc/bacula to another machine to prevent this kind of issues. HTH. Jérôme Blion. -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Cant connect to bacula-sd on debian system
Le 19/04/2012 09:47, alexturner a écrit :
> Hey all,
>
> I'm trying to set up a bacula sever to backup all machines on the network to
> LTO tape. I'm having a hard time getting my config to work. For starters
> bacula-dir wont start from the /etc/init.d/bacula-director script but it will
> start if I simply run bacula-dir in the terminal.
>
> bacula-sd runs from the init script and is listening on all ip's (as
> determined by netstat -alnp) though I can't connect to it. I've been trying
> to run this for the last few weeks and I'm starting to give up, any ideas and
> input would be highly appreciated.
>
> I've edited out a fair bit of text just to shorten the output. Sorry for not
> uploading to a pastebin.
>
> Netstat:
> root@bacula:/var/www# netstat -alnp | grep 9103
> tcp0 0 0.0.0.0:91030.0.0.0:* LISTEN
> 17140/bacula-sd
> root@bacula:/var/www#
>
> Error:
> *status
> Status available for:
> 1: Director
> 2: Storage
> 3: Client
> 4: All
> Select daemon type for status (1-4): 2
> Automatically selected Storage: bacula
> Connecting to Storage daemon bacula at 127.0.0.1:9103
>
> Failed to connect to Storage daemon bacula.
>
> You have messages.
> *messages
> 19-Apr 17:38 localhost-dir JobId 0: Fatal error: authenticate.c:120 Director
> unable to authenticate with Storage daemon at "127.0.0.1:9103". Possible
> causes:
> Passwords or names not the same or
> Maximum Concurrent Jobs exceeded on the SD or
> SD networking messed up (restart daemon).
> Please see
> http://www.bacula.org/en/rel-manual/Bacula_Freque_Asked_Questi.html#SECTION00376
> for help.
> *
>
>
>
> bacula-sd.conf
> Storage { # definition of myself
>Name = bacula
>SDPort = 9103 # Director's port
>WorkingDirectory = "/var/lib/bacula"
>Pid Directory = "/var/run/bacula"
>Maximum Concurrent Jobs = 20
> }
>
> #
> # List Directors who are permitted to contact Storage daemon
> #
> Director {
>Name = bacula-dir
>Password = "helloworld"
> }
>
> #
> # Restricted Director, used by tray-monitor to get the
> # status of the storage daemon
> #
> Director {
>Name = bacula-mon
>Password = "helloworld"
>Monitor = yes
> }
>
> Autochanger {
>Name = HP-Changer
>Device = LTO1-1
>Device = LTO1-2
>Changer Command = "/etc/bacula/scripts/mtx-changer %c %o %S %a %d"
>Changer Device = /dev/sg2
> }
>
> Device {
>Name = LTO1-1 #
>Drive Index = 0
>Media Type = LTO-1
>Archive Device = /dev/st0
>AutomaticMount = yes; # when device opened, read it
>AlwaysOpen = yes;
>RandomAccess = no;
>AutoChanger = yes
> # #
> # # Enable the Alert command only if you have the mtx package loaded
> # # Note, apparently on some systems, tapeinfo resets the SCSI controller
> # # thus if you turn this on, make sure it does not reset your SCSI
> # # controller. I have never had any problems, and smartctl does
> # # not seem to cause such problems.
> # #
> # Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
> # If you have smartctl, enable this, it has more info than tapeinfo
> # Alert Command = "sh -c 'smartctl -H -l error %c'"
> }
> Messages {
>Name = Standard
>director = bacula-dir = all
> }
>
>
> Bacula-dir.conf
> Director {# define myself
>Name = localhost-dir
>DIRport = 9101
>QueryFile = "/etc/bacula/scripts/query.sql"
>WorkingDirectory = /var/lib/bacula
>PidDirectory = "/var/run/bacula"
>Maximum Concurrent Jobs = 1
>Password = "tralala" # Console password
>Messages = Daemon
>DirAddress = 127.0.0.1
> }
>
> JobDefs {
>Name = "DefaultJob"
>Type = Backup
>Level = Incremental
>Client = bacula-fd
>FileSet = "Full Set"
>Schedule = "WeeklyCycle"
>Storage = bacula
>Messages = Standard
>Pool = File
>Priority = 10
>Write Bootstrap = "/var/lib/bacula/%c.bsr"
> }
>
>
> #
> # Define the main nightly save backup job
> # By default, this job will back up to disk in
> /nonexistant/path/to/file/archive/dir
> Job {
>Name = "BackupClient1"
>JobDefs = "DefaultJob"
> }
> Storage {
> Name = bacula
> Address = 127.0.0.1
> SDPort = 9103
> Password = "KM0K1W1aF6w-G0NU181dVtedFUKDKn4QE"
> Device = HP-Changer
> Media Type = LTO-1
> Autochanger = yes
> }
>
> Catalog {
>Name = MyCatalog
> # Uncomment the following line if you want the dbi driver
>dbdriver = "dbi:mysql"; dbaddress = 127.0.0.1; dbport = 3306;
>dbname = "bacula"
>dbuser = "root"
>dbpassword = "alexwashere"
> }
>
> +--
> |This was sent by alexandertur...@me.com via Backup Central.
> |Forward SPAM to ab...@backupcentral.com.
> +--
>
>
>
> -
[Bacula-users] Client Run Before Job overriding
Hello,
I use the following jobdefs definition:
JobDefs {
Name = "MysqlFullJob"
Type = Backup
Level = Full
Client = myserver-fd
Fileset = "Mysql Full"
Schedule = "OneFullPerDay"
Storage = File
Messages = Standard
Pool = File
Priority = 10
Maximum Concurrent Jobs = 20
Accurate = yes
Client Run Before Job = /etc/bacula/scripts/mysql_backup.sh
}
Here is my job definition:
Job {
Name = "Backup_bckclient_mysql"
Client = bckclient-fd
JobDefs = "MysqlFullJob"
Client Run Before Job = /usr/local/bacula/etc/scripts/mysql_backup.sh
}
The client has not been installed as all other ones, I would like to
replace the value of Client Run Before job.
With this setup, both commands run... and the one defined in the jobdefs
definition fails...
How could I do it ? (I would like to avoid to create an entire jobdefs
for one machine)
Best regards.
Jerome Blion.
--
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here
http://p.sf.net/sfu/sfd2d-msazure
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Low request Mysql
On Tue, 27 Mar 2012 13:10:02 +0200, Nicolas wrote: > I tried, but no changes.. > > Mysqltuner give it for "performance" : > > Performance Metrics > - > [--] Up for: 2h 40m 21s (171K q [17.787 qps], 23 conn, TX: 31M, RX: > 22M) > [--] Reads / Writes: 0% / 100% > [--] Total buffers: 572.0M global + 2.7M per thread (151 max threads) > [OK] Maximum possible memory usage: 987.2M (49% of installed RAM) > [OK] Slow queries: 0% (1/171K) > [OK] Highest usage of available connections: 1% (2/151) > [OK] Key buffer size / total MyISAM indexes: 256.0M/130.9M > [OK] Key buffer hit rate: 99.3% (2M cached / 16K reads) > [OK] Query cache efficiency: 56.9% (95 cached / 167 selects) > [OK] Query cache prunes per day: 0 > [OK] Sorts requiring temporary tables: 9% (2 temp sorts / 21 sorts) > [!!] Temporary tables created on disk: 28% (11 on disk / 38 total) > [OK] Thread cache hit rate: 91% (2 created / 23 connections) > [OK] Table cache hit rate: 74% (52 open / 70 opened) > [OK] Open file limit used: 8% (99/1K) > [OK] Table locks acquired immediately: 100% (237 immediate / 237 > locks) > [!!] Connections aborted: 8% > > On Tue, 27 Mar 2012 11:55:41 +0200, Jérôme Blion wrote: > >> On Tue, 27 Mar 2012 10:28:01 +0200, Nicolas wrote: >> >>> Oups, I made a mistake on my conf, parameters are not on >>> [mysqld]... On Tue, 27 Mar 2012 09:45:54 +0200, Nicolas wrote: >>> >>>> Hi, I try to optimize mysql with some infos find on the web, but >>>> that not better :s For the backup, it take 11 min to save datas, >>>> but 1 hour to update mysql table... My my.cnf : [mysqld] >>>> datadir=/var/lib/mysql socket=/var/lib/mysql/mysql.sock >>>> user=mysql # Disabling symbolic-links is recommended to prevent >>>> assorted security risks symbolic-links=0 [mysqld_safe] >>>> log-error=/var/log/mysqld.log >>>> pid-file=/var/run/mysqld/mysqld.pid query_cache_size=32M >>>> tmp_table_size=256M max_heap_table_size=256M thread_cache_size=4 >>>> table_cache=512 key_buffer_size=256M On Mon, 26 Mar 2012 >>>> 12:13:28 -0400, John Drescher wrote: >>>> >>>>> On Mon, Mar 26, 2012 at 12:09 PM, Nicolas wrote: >>>>> >>>>>> good idea ! i'll try it asap and let you know. >>>>> Also its best if you can have the database on a different >>>>> raid than the storage or put the database on an SSD. John M. >>>>> Drescher >>>> -- Nicolas http://www.shivaserv.fr [1] [2] >> >> Hello, >> >> Each database server is different. >> If you want to perform some tuning, you can help yourself with >> tuning-primer.sh + mysqltuner.pl. >> They provide good metrics to start with. If you are facing table >> locking issue, perhaps you should migrate to InnoDB (if you use >> Mysql >> 5.1, use the InnoDB Plugin, not the embedded one) >> >> HTH. >> Jérôme Blion (Lyon, France) Hello, Please don't obfuscate anything. tuning-primer provides more metrics data. Best regards. Jerome Blion. -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Low request Mysql
On Tue, 27 Mar 2012 10:28:01 +0200, Nicolas wrote: > Oups, I made a mistake on my conf, parameters are not on [mysqld]... > > On Tue, 27 Mar 2012 09:45:54 +0200, Nicolas wrote: > >> Hi, >> >> I try to optimize mysql with some infos find on the web, but that >> not better :s >> >> For the backup, it take 11 min to save datas, but 1 hour to update >> mysql table... >> >> My my.cnf : >> >> [mysqld] >> datadir=/var/lib/mysql >> socket=/var/lib/mysql/mysql.sock >> user=mysql >> # Disabling symbolic-links is recommended to prevent assorted >> security risks >> symbolic-links=0 >> >> [mysqld_safe] >> log-error=/var/log/mysqld.log >> pid-file=/var/run/mysqld/mysqld.pid >> >> query_cache_size=32M >> tmp_table_size=256M >> max_heap_table_size=256M >> thread_cache_size=4 >> table_cache=512 >> key_buffer_size=256M >> >> On Mon, 26 Mar 2012 12:13:28 -0400, John Drescher wrote: >> >>> On Mon, Mar 26, 2012 at 12:09 PM, Nicolas wrote: >>> >>>> good idea ! i'll try it asap and let you know. >>> >>> Also its best if you can have the database on a different raid >>> than >>> the storage or put the database on an SSD. >>> >>> John M. Drescher >> >> -- >> >> Nicolas >> http://www.shivaserv.fr [2] Hello, Each database server is different. If you want to perform some tuning, you can help yourself with tuning-primer.sh + mysqltuner.pl. They provide good metrics to start with. If you are facing table locking issue, perhaps you should migrate to InnoDB (if you use Mysql 5.1, use the InnoDB Plugin, not the embedded one) HTH. Jérôme Blion (Lyon, France) -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Off site backups
On Fri, 24 Feb 2012 16:38:13 +0100, Johannes Fabian Rußek wrote: > I'm sorry, maybe I did not write it clear enough into my mail: > > [...] and does not want to rely on NFS across datacenters > > or rsyncing, for various reasons (throughput, security, > > reliability...) > > On Fri, Feb 24, 2012 at 4:30 PM, John Drescher wrote: > >> 2012/2/24 Johannes Fabian Rußek : >> >>> Hi everybody, >> > I'm planning on how move off-site backups around from bacula. >> > Originally I thought something like the copy or migration job >> from one >> > SD on one site to another SD at a second site, but I realized >> that >> > migration jobs only work within one SD. >> > I guess I am not the first or only person that needs to store >> backups >> > in several places and does not want to rely on NFS across >> datacenters >> > or rsyncing, for various reasons (throughput, security, >> > reliability...) >> > How do people generally do this kind of job or what is the >> advised way >> > to do that? >> >> rsync the volume files. >> >> John Hello, What about using a Tape library and physically export tapes from one datacenter to another one ? You have to manage physical accesses to datacenters... For huge volumes, you can have very good transfer rates ! 50 LTO4 tapes = 60TB with a 1h car trip ==> 133 mbps HTH. Jérôme Blion. -- Virtualization & Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Scheduling hourly backups with different levels and pools
On Wed, 22 Feb 2012 08:29:22 -0500, John Drescher wrote:
> 2012/2/22 :
>>
>> Hi,
>>
>> I'm in the process of setting up MySQL backups in Bacula, using
>> mysqldump
>> for full backups and backing up my bin logs for incremental backups.
>>
>> What I would like to do is to perform a full backup to my full
>> backup pool
>> at 00:00 every night, then perform incremental backups to my
>> incremental
>> pool every hour thereafter.
>>
>> Just as a rough config, I have the current schedule at the moment,
>> whilst
>> testing:
>>
>> Schedule {
>> Name = "TestServer MySQL Database Schedule"
>> Run = Level=Full pool=TestServer_MySQL_Full
>> Storage=TestServer_MySQL_Full
>> daily at 00:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 01:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 02:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 03:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 04:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 05:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 06:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 07:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 08:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 09:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 10:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 11:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 12:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 13:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 14:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 15:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 16:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 17:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 18:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 19:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 20:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 21:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 22:00
>> Run = Level=Incremental pool=TestServer_MySQL_Inc
>> Storage=TestServer_MySQL_Inc daily at 23:00
>> }
>>
>> I feel that there must be another, cleaner, way to define this kind
>> of
>> backup schedule, but I can't seem to be able to find one from the
>> manual.
>>
>
> You could make the default level Incremental and the default Pool
> TestServer_MySQL_Inc in your Job and cut all overrides but the full
> however I would leave this alone. Your schedule is fine.
>
> John
Hello,
As far as I see, you only have 2 pools, one for each type.
Why don't you use hourly keyword to schedule incrementals backups ?
HTH.
Jérôme Blion.
--
Virtualization & Cloud Management Using Capacity Planning
Cloud computing makes use of virtualization - but cloud computing
also focuses on allowing computing to be delivered as a service.
http://www.accelacomm.com/jaw/sfnl/114/51521223/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Space reclamation
On Thu, 16 Feb 2012 14:10:56 +0100, Jérôme Blion wrote: > On Thu, 16 Feb 2012 13:36:45 +0100 (CET), Demeter Tibor wrote: >> Hi, >> >> Are there any option in bacula for the tape space reclamation ? I >> know >> and use this option from Tivol storage manager. >> >> How can I "defragment" my tapes? >> >> Thanks, >> >> Tibor > > Basically, TSM keeps files as long as they are active. So you can > have big holes in your tapes. > That's not the way Bacula works. Bacula will expire files according > to their retention. Once they have been expired, they will be backed > up one So... One more time... Expiration processes does not work the same way between TSM and Bacula. As long as a file is active (present on the client), it is not removed from tapes (depending on versions count and so on..) That means that, after some times, you will have less and less files on each tape, and so, space reclamation will be needed to aggregate all files. Bacula stores each file, job, volume according to its retention. Once this retention has been reached, files and jobs will be deleted (only in the catalog, in fact). Once the volume retention has been reached, the volume is purged and can be reused. Bacula will try and fill oldest appendables tapes first in order to free oldest tapes as soon as possible. TSM uses permanent incremental, Bacula does not. Backup times are much faster with TSM... Restore times are not ! HTH. Jerome Blion. -- Virtualization & Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Space reclamation
On Thu, 16 Feb 2012 13:36:45 +0100 (CET), Demeter Tibor wrote: > Hi, > > Are there any option in bacula for the tape space reclamation ? I > know > and use this option from Tivol storage manager. > > How can I "defragment" my tapes? > > Thanks, > > Tibor Basically, TSM keeps files as long as they are active. So you can have big holes in your tapes. That's not the way Bacula works. Bacula will expire files according to their retention. Once they have been expired, they will be backed up one -- Virtualization & Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses on allowing computing to be delivered as a service. http://www.accelacomm.com/jaw/sfnl/114/51521223/ ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Schedule virtual servers so their not running concurrently
On Mon, 30 Jan 2012 11:20:15 +, keith wrote: > We have about 80 virtual servers running on 20 Physical servers that > need backed up. > > Our Bacula implementation is now at scheduling stage and we are stuck > trying to figure out how to get the virtual servers to backup without > them all running concurrently overwhelming the physical servers that > they are on. > > Our current plan is to have just one Schedule that will start at 1am > then we will give each virtual server a unique priority, We plan to > give > the the first Job a priority of 5 then the next 10 and on.This > seems > a messy but I can't see any other way to stop or limit the number of > virtual servers on the same physical server from running at the same > time. > > There must be other people with load of virtual servers that have the > same issues. This has probably been that forth or fifth email that I > have written to this group. I've never sent the previous ones as I > 've > always found a solution before sending the email, but this time I'm > stuck. It seems that the people that make Bacula what it is have > though > of everything and I'm just hoping there an elegant solution to my > problem. > > Any help is really appreciated. > > Thanks > Keith Maximum Concurrent Jobs could probably save you lot of time. HTH. Jérôme Blion. -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] New(ish) tool for MySQL catalog backups
On Thu, 26 Jan 2012 22:28:43 -0500, Phil Stracchino wrote: > Possibly *slightly* off-topic: > > Those using MySQL for their catalog DB (well, actually, any of you > using > MySQL, but that includes Bacula catalogs) may find this interesting: > > http://www.mydumper.org/ > > It is a mysqldump replacement created by a couple of former MySQL AB > support engineers. It is multithreaded, does parallel dumps, can be > told to ignore specified storage engines, has a daemon mode in which > it > does periodic incremental dumps, and automatically generates > consistent > dumps from both transactional and non-transactional storage engines > without the multiple (about 12) options required to achieve the same > ends with mysqldump. It stores schema and data in separate files, > and > supports both file and DB-connection compression. > > In short, it's what mysqldump SHOULD have become by now, but hasn't. Hello, For huge databases, a dump is really too slow to restore. mylvmbackup can take a consistent snapshot of the database. The backup is a bit longer, the backup file is bigger, restore is much faster ! Anyway, I use mydumper for small databases. I used to use mk-parallell-dump until it began to generate OOM errors. (maatkit team does not recommend mk-paralle-dump for production use) HTH. Jérôme Blion -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Full backup every day instead of Incremental backup
On Mon, 16 Jan 2012 09:16:38 -0500, John Drescher wrote:
> On Mon, Jan 16, 2012 at 9:05 AM, Sebastien Douche
> wrote:
>> Hi :),
>> I define a weekly schedule (full backup thes unday and incremental
>> for
>> the rest):
>>
>> Schedule {
>> Name = "WeeklyCycle"
>> Run = Full sun at 23:05
>> Run = Incremental mon-fri at 23:05
>> }
>>
>> But Bacula make a full backup each day:
>>
>> JobId Level Files Bytes Status Finished Name
>>
>> 40 Full 120 57.09 M OK 15-Jan-12 23:12 Deb
>> 41 Full 72,268 98.79 G OK 16-Jan-12 01:31
>> Fileserver
>> 42 Full 674 12.21 G OK 16-Jan-12 01:45
>> Clonezilla
>>
>> Schedule: name=WeeklyCycle
>> --> Run Level=Full
>> hour=23
>> mday=0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22
>> 23 24 25 26 27 28 29 30
>> month=0 1 2 3 4 5 6 7 8 9 10 11
>> wday=0
>> wom=0 1 2 3 4
>> woy=0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22
>> 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45
>> 46 47 48 49 50 51 52 53
>> mins=5
>> --> Run Level=Incremental
>> hour=23
>> mday=0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22
>> 23 24 25 26 27 28 29 30
>> month=0 1 2 3 4 5 6 7 8 9 10 11
>> wday=1 2 3 4 5 6
>> wom=0 1 2 3 4
>> woy=0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22
>> 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45
>> 46 47 48 49 50 51 52 53
>> mins=5
>>
>> Why mday are set? I'm a bit lost :(.
>>
>
> Do you have the messages or the log for the last few jobs? I suspect
> the incremental is getting upgraded from a full because bacula
> believes no prior full exists.
>
> John
>
Hello,
mday + wday = a sunday between 1 and 31... So, any sunday. That's just
what you want.
Jobs 40,41,42 are different jobs... Each one will create its own full
job (upgraded from incremental if no full has been created)
HTH.
Jérôme Blion
--
RSA(R) Conference 2012
Mar 27 - Feb 2
Save $400 by Jan. 27
Register now!
http://p.sf.net/sfu/rsa-sfdev2dev2
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] RE : HELP : MySQL database lost - how best to restore data
Le 06/11/2011 23:06, Win Htin a écrit : > Hi folks, > > Thanks for the various suggestions. I found setting the variables > export MYSQL_HOST= > export MYSQL_TCP_PORT= > export MYSQL_UNIX_PORT= > before running the "bscan" command did the trick. > Now, have to see if my "bscan" will work. > > Thanks, > Win > > On Sun, Nov 6, 2011 at 4:13 PM, Konstantin Khomoutov > wrote: >> On Sun, 6 Nov 2011 15:50:13 -0500 >> Win Htin wrote: >> >>> To make matters worse, the MySQL database is running on a none default >>> port. Since "bscan" doesn't have an option to set the port number I am >>> in a bit of a bind. Any ideas? >> Try environment variables listed at >> http://dev.mysql.com/doc/refman/5.0/en/environment-variables.html >> Hello, By default, Bacula stores the catalog dump in /var/lib/bacula/ root@bckserver:/var/lib/bacula# ls -l /var/lib/bacula/bacula.sql -rw--- 1 bacula bacula 1605037178 6 nov. 04:36 /var/lib/bacula/bacula.sql Perhaps it will be faster to recover from it ? HTH. Jerome Blion. -- RSA(R) Conference 2012 Save $700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Backup MySQL databases
Hello, On Tue, 25 Oct 2011 07:34:06 -0400, Phil Stracchino wrote: > > MySQLdump is a valid technique, and the simplest working technique. > You > should not, as a rule, back up the MySQL data directory at filesystem > level. It is extremely unlikely to yield a consistent backup. If > you're going to attempt this, issue a FLUSH TABLES WITH READ LOCK, > snapshot the MySQL directory, release the lock, then mount the > snapshot > and back up the snapshot. Thanks to InnoDB's write-ahead logs and > crash > recovery features, this technique is generally safe *IF ALL YOUR > DATABASES ARE IN INNODB TABLES*.[1] With mylvmbackup, you can backup any type of engine which writes on disk (don't expect to recover memory table...) as long as you flush buffers to disk. MyLVMBackup sends a flush tables with read lock, creates a snapshot, releases the lock and then archives the snapshot. That means that during the snapshot's creation, nothing will change into any database. That works with MyISAM too (because tables have been flushed to disk). (I tested it in real situations) > The big problem with MySQLdump is that while the logical dump is > portable, it is slow to dump and slower still to restore. You might > want to look into a third party tool such as Percona XtraBackup to > make > a consistent copy of your MySQL data directory, then back up that > copy. > In some very large servers I have tested it on, XtraBackup runs in > about an hour where MySQLdump takes many hours. Unlike MySQLdump, it > can perform incremental backups of the DB. > > You might also investigate MySQL Enterprise Backup. It is similar to > XtraBackup, but more finished. I performed some tests with a 150 GB database (mostly InnoDB + MyISAM). mysqldump : to be coherent, we needed to stop the service during 15 minutes mylvmbackup : the service was blocked during 3-5 seconds. I tried to restore with both methods : mysqldump : 20hours mylvmbackup : 2 hours (including recovering 23h of binlogs ! I was really unlucky this day) There is some cons : - A gzipped snapshot is much bigger than a gzipped plaintext file. That means you have to reserve enough space to store the final archive file. - You can't split your datadir accross several mountpoints. HTH. Jérôme Blion -- The demand for IT networking professionals continues to grow, and the demand for specialized networking skills is growing even more rapidly. Take a complimentary Learning@Cisco Self-Assessment and learn about Cisco certifications, training, and career opportunities. http://p.sf.net/sfu/cisco-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] How do I remove clients from the database?
Le 28/09/2011 20:41, Stefan Michael Guenther a écrit : > Hello, > > I have removed a number of clients from bacula-dir.conf and restarted the > director. > > In the bconsole "list clients" still lists the removed clients. The delete > command only allows me to remove volumes, pools and jobids. > > So, how do I remove/delete clients? > > Thanks for any hints/suggestions, > > Stefan Hello, dbcheck is your friend :) Be sure you have no data pieces related to these clients. Best regards. Jerome Blion. -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity and more. Splunk takes this data and makes sense of it. Business sense. IT sense. Common sense. http://p.sf.net/sfu/splunk-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Copy jobs
Hello,
I'm trying to copy jobs from one server to another.
I defined 2 storage daemons:
==
# Definition of file storage device
Storage {
Name = "File"
Address = tucana.domain# N.B. Use a fully qualified
name here
SDPort = 9103
Password = "password1"
Maximum Concurrent Jobs = 5
Device = FileStorage
Media Type = File
}
Storage {
Name = "File-Copy"
Address = carina.domain
SDPort = 9103
Password = "password2"
Maximum Concurrent Jobs = 5
Device = FileStorage
Media Type = File
}
==
I defined 2 pools:
==
# File Pool definition
Pool {
Name = File
Pool Type = Backup
Recycle = yes # Bacula can automatically
recycle Volumes
LabelFormat = "Vol"
AutoPrune = yes # Prune expired volumes
Volume Retention = 35 days # one month
Maximum Volume Bytes = 50G # Limit Volume size to something
reasonable
Maximum Volumes = 100 # Limit number of Volumes in Pool
Recycle Oldest Volume = yes
RecyclePool = Scratch
NextPool = File-Copy
}
# File Pool definition
Pool {
Name = File-Copy
Pool Type = Backup
Recycle = yes # Bacula can automatically
recycle Volumes
LabelFormat = "Copy"
AutoPrune = yes # Prune expired volumes
Volume Retention = 35 days # one month
Maximum Volume Bytes = 50G # Limit Volume size to something
reasonable
Maximum Volumes = 80# Limit number of Volumes in Pool
Recycle Oldest Volume = yes
Storage = "File-Copy"
}
==
Then, I created a job:
==
Job {
Name = "CopyJob"
Type = Copy
Level = Full
Client = tucana-fd
FileSet = "Full Set"
Messages = Standard
Pool = File
Maximum Concurrent Jobs = 4
Storage = "File"
Selection Type = Client
SelectionPattern = tucana-fd
}
==
When I run it, I have the following director status:
Running Jobs:
Console connected at 15-août011 14:34
Console connected at 15-août011 17:53
JobId Level Name Status
==
25044 FullCopyJob.2011-08-15_17.47.16_39 is waiting on max Client jobs
25045 FullCopyJob.2011-08-15_17.47.16_40 is waiting on Storage
File-Copy
25046 Increme Backup_tucana.2011-08-15_17.47.16_41 is waiting on
Storage File
25047 FullCopyJob.2011-08-15_17.47.16_42 is waiting on max Client jobs
In this link:
http://www.bacula.org/manuals/en/concepts/concepts/Migration_Copy.html
It's written that "Migration is only implemented for a single Storage
daemon. You cannot read on one Storage daemon and write on another."
Is this sentence still true ?
Can you confirm I'm concerned by this limitation ?
Best regards.
Jerome Blion.
--
uberSVN's rich system and user administration capabilities and model
configuration take the hassle out of deploying and managing Subversion and
the tools developers use with it. Learn more about uberSVN and get a free
download at: http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Files, jobs and volumes retention
Le 02/08/2011 17:35, Bacula-Dev a écrit :
> Dear all,
>
> I need a more clear explanation on bacula retentions.
>
> Here's an example of what I would like to define on my director
>
> Pool {
> Name = Full
> Pool Type = Backup
>
> Volume Retention = 2 weeks
> }
>
> JobDefs {
>
> Job Retention = 4 weeks
> File Retention = 6 months
>
> }
>
> and so on
>
> Assuming that I scheduled an incremental job every day and at the end
> of the month (eg. last Saturday), I scheduled a full backup of my client.
> What about my previous full backup if I defined the job retention to 4
> weeks (should be 2 months - 1 day).
>
> If the volume retention is applied without taking care of the Job
> retention,
> I'll not be able to restore an incremental job without the previous
> full (that has been deleted by the volume retention).
>
> Am I right ?
>
> Thanks for your feedback.
Volumes will be recycled only if there are no jobs remaining on them.
For job and files, I don't know if we've got the same case.
HTH.
Jérôme Blion.
--
BlackBerry® DevCon Americas, Oct. 18-20, San Francisco, CA
The must-attend event for mobile developers. Connect with experts.
Get tools for creating Super Apps. See the latest technologies.
Sessions, hands-on labs, demos & much more. Register early & save!
http://p.sf.net/sfu/rim-blackberry-1
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Migrating form mysql to postgresql: Loading the database takes very long
On Wed, 22 Jun 2011 12:22:34 +0200, Marcus Mülbüsch wrote: > Am 22.06.2011 12:05, schrieb Jérôme Blion: > >> I don't know how you dumped your mysql database. >> Did you try to use mysqldump -T ? mysql2pgsql ? >> I used some other scripts to migrate data pieces. I will look for them >> this evening... > > mysqldump -t -n -c --compatible=postgresql --skip-quote-names --skip-opt > --disable-keys --lock-tables -ubacula -p -q bacula | grep -v "INSERT > INTO Status" | sed -e 's/-00-00 00:00:00/1970-01-01 00:00:00/g' | > sed -e 's/\\0//' > bacula-backup.sql So you should really try mysqldump -T... This is known to be much faster (then use copy from ...) Did you try some tools like http://www.sql-workbench.net/ or http://sqlfairy.sourceforge.net/ ? Cordialement. Jérôme Blion. -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Migrating form mysql to postgresql: Loading the database takes very long
On Wed, 22 Jun 2011 10:54:31 +0200, Marcus Mülbüsch wrote: > Am 22.06.2011 06:14, schrieb Stuart McGraw: > >> You can identify the indexes from the CREATE INDEX commands >> in /usr/libexec/bacula/make_postgresql_tables. Drop them >> prior to loading, and then rerun the CREATE INDEX commands >> after loading -- it can make a big difference in loading >> time. > > I will watch whether psql will be finished today, and if it's not: > switch back to mysql for this weekend (which thanks to a holiday and a > bridging day will start this evening ;) > > Next week I'll try your suggestion. > > Thanks for the instructions. > > Marcus Hello, I don't know how you dumped your mysql database. Did you try to use mysqldump -T ? mysql2pgsql ? I used some other scripts to migrate data pieces. I will look for them this evening... HTH. Jérôme Blion. -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Data protection magic? Nope - It's vRanger. Get your free trial download today. http://p.sf.net/sfu/quest-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] recommendations for scheduling
Le 15/06/2011 19:41, Ben Walton a écrit : > Hi All, > > I'm slowly getting comfortable with bacula configuration and have a > few test setups running right now. One thing I'm not quite clear on > is the best way to write schedules such that I don't end up with all > of my full backups happening on the same night. My current > understanding indicates that I'd just need to write several schedules > and manually load balance the clients over this set. Is there a > smarter way to accomplish this? > > Thanks > -Ben > -- > Ben Walton > Systems Programmer - CHASS > University of Toronto > C:416.407.5610 | W:416.978.4302 Hello, That will depends your needs. You can play with several schedules. You can play with Maximum Concurrent Jobs to balance jobs during the night. HTH. Jérôme Blion. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
Le 08/06/2011 19:16, Gavin McCullagh a écrit : > On Wed, 08 Jun 2011, Jérôme Blion wrote: > >> You will see performance improvements if you have lot of concurrents >> updates. > I don't imagine concurrent updates are really an issue for us. Our backups > run fast enough generally for our purposes . I daresay they could be > faster, but they're not causing us a problem. It's the time for a restore > to build the file tree that's a problem. > > The particularly bad restore in question is a Cyrus IMAP server with about > 5 million files in a full backup. The worst case would be a monthly full, > a weekly differential and 6 days of incrementals to assemble. > > Gavin What tool do you use to perform restore ? I had such issues with BAT... With Webacula, I am not able to reproduce this behaviour. Perhaps a bad query which does not use an index. HTH. Jérôme Blion. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
Le 08/06/2011 18:16, Gavin McCullagh a écrit : > Hi, > > On Wed, 08 Jun 2011, Phil Stracchino wrote: > >> The very first thing I would do would be upgrade to MySQL 5.5.[current] >> (5.5.13, right now) if you're not already using 5.5, making sure it's >> properly configured (hint: look at the new configuration directive >> innodb_buffer_pool_instances), then throw as much RAM as possible at the >> InnoDB buffer pool and convert all of the tables to InnoDB. Then >> download MySQltuner (http://mysqltuner.com/mysqltuner.pl) and look at >> its recommendations for some basic tuning. >> >> MyISAM, frankly, *SHOULD* be deprecated at this point. There is still a >> lot of FUD about InnoDB performance out there, most of it from people >> who don't actually understand the performance implications of the >> differences between MyISAM and InnoDB, but the truth is there is >> virtually no use case on a conventional MySQL server[1] for which "What >> primary storage engine should I be using?" has any answer other than >> "InnoDB". It's probably not too inaccurate to say that unless you >> *NEED* either merge tables or full-text indices, you should be using InnoDB. > For simplicity of operation and patching, we're using the Ubuntu archive > packages which are MySQL 5.1.41. I realise that's quite old now. There > are one or two restores in particular which take a long time (like 30 > minutes) to build the restore tree. I'm guessing the reason is these > tables: > > -rw-rw 1 mysql mysql 7.4G 2011-06-08 13:24 File.MYD > -rw-rw 1 mysql mysql 5.1G 2011-06-08 13:24 File.MYI > -rw-rw 1 mysql mysql 233M 2011-06-08 13:24 Filename.MYI > -rw-rw 1 mysql mysql 161M 2011-06-08 13:24 Filename.MYD > -rw-rw 1 mysql mysql 153M 2011-06-08 13:24 Path.MYI > -rw-rw 1 mysql mysql 99M 2011-06-08 13:24 Path.MYD > > Addressing this with a move to PostgreSQL has been on my list but I might > try a move to InnoDB first as it's likely much simpler. > > Assuming that version of MySQL, do you know if the case for InnoDB vs > MyISAM is still as cut and dry? Would we likely see substantial > performance improvements? > > Thanks for any help, > > Gavin > Hello, You will see performance improvements if you have lot of concurrents updates. Which Bacula version do you have ? Perhaps it's an index issue. HTH Jérôme Blion -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Database performance issues
On Wed, 08 Jun 2011 10:50:58 -0400, Phil Stracchino wrote: > The very first thing I would do would be upgrade to MySQL 5.5.[current] > (5.5.13, right now) if you're not already using 5.5, making sure it's > properly configured (hint: look at the new configuration directive > innodb_buffer_pool_instances), then throw as much RAM as possible at the > InnoDB buffer pool and convert all of the tables to InnoDB. Then > download MySQltuner (http://mysqltuner.com/mysqltuner.pl) and look at > its recommendations for some basic tuning. InnoDB is not so easy to setup. The biggest buffer is not always the best one. innodb_buffer_size should be bigger than innodb data pieces. You should seize logfiles according to the database activity. You should set innodb_file_per_table... and so on... When we are speaking about Mysql performance, you could have a look on InnoDB plugin. Barracuda file format is much faster than the previous one, the innodb plugin is known to improve performance. > MyISAM, frankly, *SHOULD* be deprecated at this point. There is still a > lot of FUD about InnoDB performance out there, most of it from people > who don't actually understand the performance implications of the > differences between MyISAM and InnoDB, but the truth is there is > virtually no use case on a conventional MySQL server[1] for which "What > primary storage engine should I be using?" has any answer other than > "InnoDB". It's probably not too inaccurate to say that unless you > *NEED* either merge tables or full-text indices, you should be using > InnoDB. SELECT are slower on a InnoDB table. (but is much more reliable) When the database has a really slow update frequency, MyISAM can be interesting. For bacula purposes, I would suggest to use mysqltuner.pl and tuning-primer.sh to detect some incorrect values. They can improve performance a lot. HTH. Jérôme Blion. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Can't connect to Director on port 9101
On Mon, 06 Jun 2011 18:24:58 -0700, favouritekid wrote: > Hi evryone,i have a error! > After i completed install bacura on server,i try connect to director on > client...it's error. > > I use command on client: > #bconsole > ---> not have output > To test: > #netstat -a | grep 9101 --> not have output > > and > > #netstat - a | grep bacula > tcp0 0 *:bacula-fd*:* LISTEN Hello, do backup work fine ? Could you show us your bacula-dir.conf file ? HTH. Jérôme Blion. -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Scheduling
On Mon, 6 Jun 2011 22:28:39 -0500, Jake Debord wrote: > Do you have a very specific reason for this? You realize that's a full > year goes by before you back up. And then you run two backups within a two > day period. A full backup on the first right after the 31st of December is > almost wasteful I would imagine. You may could get by with a little > different setup? A differential on the 1st may be better depending on your > situation. Just my two cents worth :) > > Sent from my iPhone. > > On Jun 6, 2011, at 6:46 PM, Kleber Leal wrote: > >> The fist day of year: >> Run = Full jan 1 at 2:00 >> >> The latest day of year: >> Run = Full dec 31 at 2:00 >> >> Kleber >> >> 2011/6/6 Paul Fontenot >> Is there a scheduling option for the first day of the year or th elast >> day of the year? Hello, I think he wanted to perform a yearly backup... Either on the first year's day or the last one... -- EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula maintenance : Clean Data
On Mon, 6 Jun 2011 16:40:01 +0200, Buschini Edouard wrote: > Hello Jérôme, > > 2011/6/6 Jérôme Blion > >> On Mon, 6 Jun 2011 15:45:24 +0200, Buschini Edouard >> wrote: >> > Hi Alan, >> > >> > Thank you for you answer. >> > >> > 2011/6/6 Alan Brown >> > >> >> Buschini Edouard wrote: >> >> >> >> But today we have a big problem, we didn't anticipate a growing like >> >> that, >> >>> on our FS we are at 97% of space used. It's very problematic. And >> since >> >>> 1 >> >>> week I'm working on free more space but it's very complicated with >> >>> Bacula. >> >>> I've search every where but I didn't find any exploitable answers so >> I'm >> >>> asking here. >> >>> Do you have a prefered method to do the following task : >> >>> >> >> >> >> 1: Can you add more storage? >> >> >> >> I can but I would like to do some clean up before. Add space disk >> > move temporarily the issue :( >> > >> > >> >> 2: Why not use tape? >> >> >> > I don't know when I arrived in the company it has already been designed >> > like >> > that : Dell server with 15kSAS raid10 >> >> Hello, >> >> You should set : >> - Maximum Volume Bytes >> - Maximum Volumes >> - Volume Retention >> - Job Retention >> - File Retention >> according to the space you can use. Volumes should be recycled then and >> will never fill up your filesystem. >> > > Yep that's I understood, so if I set the File retention to 1 month, my > volume automatically is marked as purged and next time it will be prune and > truncated right ? Hello, The way I manage the disk space allows me not to worry on disk's usage. I have no Maximum Volume jobs parameters. So, all volumes fill up until "Maximum Volume Bytes" value. I rely on disk MTBF... I won't have more than "Maximum Volumes"' value volumes. I'm sure I won't grow over MVB x MV. I sized it to fill 90% of my FS. You can play with these 2 parameters to generate one file per day, per week... as you want. Then I set up File and Job and Volume retention to what I need (in my case, 30 days everywhere) When a volume is full, Bacula will look for any appendable one. If there are no one, it will look for an expired volume and will recycle it. In your case, to go back to a normal situation, you will have to change all retention values... into the configuration but also in the database to be sure your files/jobs/volumes will expire. Then you will just have to watch Bacula recycle your volumes. I don't truncate them because I don't need to reclaim the space. HTH. Jérôme Blion. -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Discover what all the cheering's about. Get your free trial download today. http://p.sf.net/sfu/quest-dev2dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula maintenance : Clean Data
On Mon, 6 Jun 2011 15:45:24 +0200, Buschini Edouard wrote: > Hi Alan, > > Thank you for you answer. > > 2011/6/6 Alan Brown > >> Buschini Edouard wrote: >> >> But today we have a big problem, we didn't anticipate a growing like >> that, >>> on our FS we are at 97% of space used. It's very problematic. And since >>> 1 >>> week I'm working on free more space but it's very complicated with >>> Bacula. >>> I've search every where but I didn't find any exploitable answers so I'm >>> asking here. >>> Do you have a prefered method to do the following task : >>> >> >> 1: Can you add more storage? >> >> I can but I would like to do some clean up before. Add space disk > move temporarily the issue :( > > >> 2: Why not use tape? >> > I don't know when I arrived in the company it has already been designed > like > that : Dell server with 15kSAS raid10 Hello, You should set : - Maximum Volume Bytes - Maximum Volumes - Volume Retention - Job Retention - File Retention according to the space you can use. Volumes should be recycled then and will never fill up your filesystem. If you still don't have enough space, that means: - you need to buy some hardware - you need to change one (or more) of these parameters to fit your filesystem. If you only prune old jobs without modifying your backup strategy, you will have the same problem in few weeks... or even few days... HTH. Jérôme Blion. -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Discover what all the cheering's about. Get your free trial download today. http://p.sf.net/sfu/quest-dev2dev2 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Archive function ?
On Mon, 30 May 2011 12:41:14 +0400, Konstantin Khomoutov wrote: > On Mon, 30 May 2011 09:24:06 +0200 > Jérôme Blion wrote: > >> >> > > [ delete files after backup ] >> >> > > Does exist any configuration option for that? >> >> > > >> >> > No. >> >> Not yet... :) >> > IMNSHO it allready exists, it is named 'RunAfterJob' >> That's not true. An archive function would only delete files which >> have been archived successfully. >> Performing an "simple" rm will not provide the same feature. As it >> will delete any file. > I don't see a real problem statement here: a job backs up a set of > files defined by a specific fileset, and if the said job completes > without errors, you're safe to `rm' every file referred to by that > fileset. > > P.S. > I'm not against the imaginary "archive function", just trying to clear > things up. Hello, If a file to archive has been created after the files list creation, you will remove it without archiving it. HTH. Jerome Blion. -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Archive function ?
On Mon, 30 May 2011 09:05:21 +0200, Geert Stappers wrote: > Op 20110527 om 20:44 schreef Radosław Korzeniewski: >> 2011/5/27 John Drescher >> > 2011/5/27 Robert Kromoser : >> > > [ delete files after backup ] >> > > Does exist any configuration option for that? >> > > >> > No. >> >> Not yet... :) > > IMNSHO it allready exists, it is named 'RunAfterJob' > > > Stappers Hello, That's not true. An archive function would only delete files which have been archived successfully. Performing an "simple" rm will not provide the same feature. As it will delete any file. HTH. Jérôme Blion. -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] help = Problem with webacula - no grafical output
Hello, You should use credentials you provided into config.ini. That should do the trick. Then you will be able to add some accounts. HTH. Jérôme Blion. On Thu, 26 May 2011 15:20:53 +0200, AliKate AliKatador wrote: > Hello: > > Now I'm NEAR :D:D:D > > I install the Zend Framework with apt-get ... like apt-get > zendframework-bin > > But I think that was not the matter! And don't think that the > /usr/share is a problem ... > > Now I can connect to the access page webacula. As you advised me, I > checked the error.log of apache and it was where I found the problem. > I could not Connect with the MySQL server. The pass did not match. I > did not changed, and I'm the only one to connect on this laptop. I > could not even connect from a terminal, even from the > MySQLAdministrator. So I restored it and now I can connect to the > database. > > But now I have another problem. I do not log in webacula. I can not > connect with root, or the usuer that I have created. Are there any log > for this too?? > > Or is it again a permission problem ??? > > Thank's. > > > > 2011/5/26 Jérôme Blion : >> Hello, >> >> I think the whole webacula folder has nothing to do in /var/www >> /usr/share is better... then you can configure Apache configuration >> files: >> >> ln -s /usr/share/webacula/install/apache/webacula.conf >> /etc/apache2/conf.d/ >> >> >> I think you should have installed Zend framework with aptitude, too... >> This way, it will be maintained with other OS packages. >> >> Any error should be logged in your apache error log. >> >> HTH Jérôme Blion. >> >> >> Le 26/05/2011 01:52, AliKate AliKatador a écrit : >>> Hello again: >>> >>> I have installed: >>> >>> texlive-base >>> >>> latex2html >>> >>> apt-get install apache2 php5 libapache2-mod-php5 >>> >>> apt-get install php5-mysql php5-gd phpmyadmin >>> >>> phymyadmin is not necesary but I want try it too ... it works fine >>> >>> my "check_system_requirements" are all right >>> >>> cp -rfp webacula-5.5/* /var/www/webacula >>> >>> my webacula is installed in /var/www/webacula >>> >>> I got Zend Framework from : >>> http://framework.zend.com/releases/ZendFramework-1.11.5/ZendFramework-1.11.5-minimal.tar.gz >>> The minimal is enough ... I think. >>> >>> I coy it to the right path cp -rfp >>> ZendFramework-1.11.5-minimal/library/Zend/ /var/www/webacula/library/ >>> >>> I copy it directly, no soft link. >>> >>> I edit /var/www/webacula/application/config.ini >>> >>> I copy it to cp /var/www/webacula/install/apache/webacula.conf >>> /etc/apache2/conf.d/webacula.conf >>> >>> In webacula.conf I change all paths /usr/share/webacula/html for >>> /var/www/webacula/html and so on ... >>> >>> a2enmod rewrite it's right too >>> http://localhost/webacula/test_mod_rewrite/ works fine too >>> >>> I edit it too pico /etc/php5/apache2/php.ini >>> >>> I edit pico /var/www/webacula/install/db.conf >>> >>> I execute ./10_make_tables.sh ./20_acl_make_tables.sh with no erros, >>> all right >>> >>> I edit pico /var/www/webacula/html/.htaccess adn set it to production >>> >>> Also I have thinks like: >>> >>> modify /etc/bacula/bacula-dir.conf section Messages >>> >>> chown -R www-data. /var/www/webacula >>> >>> groupadd bacula >>> >>> usermod -aG bacula www-data >>> >>> chown root:bacula /sbin/bconsole >>> chmod u=rwx,g=rx,o= /sbin/bconsole >>> chown root:bacula /etc/bacula/bconsole.conf >>> chmod u=rw,g=r,o= /etc/bacula/bconsole.conf >>> >>> htpasswd -c /etc/apache2/webacula.users bacula >>> >>> And http://localhost/webacula I get it ... I type root and the pass >>> ... but then after log in ... I can see anything ... no errors ... no >>> message ... nothing ... a blank screen is all i got. >>> >>> Now I give chmod 777 for /var/www/webacula/data in /data I only have >>> /cache and a README nothing more. >>> >>> I haven't no /tmp and no /session >>> >>> I restart apache server, bacula ... and the computer too. It simply >>> don't work. >>> >>> I think as you ... it will be a rights issue >>> >>> >
Re: [Bacula-users] help = Problem with webacula - no grafical output
Hello, I think the whole webacula folder has nothing to do in /var/www /usr/share is better... then you can configure Apache configuration files: ln -s /usr/share/webacula/install/apache/webacula.conf /etc/apache2/conf.d/ I think you should have installed Zend framework with aptitude, too... This way, it will be maintained with other OS packages. Any error should be logged in your apache error log. HTH Jérôme Blion. Le 26/05/2011 01:52, AliKate AliKatador a écrit : > Hello again: > > I have installed: > > texlive-base > > latex2html > > apt-get install apache2 php5 libapache2-mod-php5 > > apt-get install php5-mysql php5-gd phpmyadmin > > phymyadmin is not necesary but I want try it too ... it works fine > > my "check_system_requirements" are all right > > cp -rfp webacula-5.5/* /var/www/webacula > > my webacula is installed in /var/www/webacula > > I got Zend Framework from : > http://framework.zend.com/releases/ZendFramework-1.11.5/ZendFramework-1.11.5-minimal.tar.gz > The minimal is enough ... I think. > > I coy it to the right path cp -rfp > ZendFramework-1.11.5-minimal/library/Zend/ /var/www/webacula/library/ > > I copy it directly, no soft link. > > I edit /var/www/webacula/application/config.ini > > I copy it to cp /var/www/webacula/install/apache/webacula.conf > /etc/apache2/conf.d/webacula.conf > > In webacula.conf I change all paths /usr/share/webacula/html for > /var/www/webacula/html and so on ... > > a2enmod rewrite it's right too > http://localhost/webacula/test_mod_rewrite/ works fine too > > I edit it too pico /etc/php5/apache2/php.ini > > I edit pico /var/www/webacula/install/db.conf > > I execute ./10_make_tables.sh ./20_acl_make_tables.sh with no erros, all > right > > I edit pico /var/www/webacula/html/.htaccess adn set it to production > > Also I have thinks like: > > modify /etc/bacula/bacula-dir.conf section Messages > > chown -R www-data. /var/www/webacula > > groupadd bacula > > usermod -aG bacula www-data > > chown root:bacula /sbin/bconsole > chmod u=rwx,g=rx,o= /sbin/bconsole > chown root:bacula /etc/bacula/bconsole.conf > chmod u=rw,g=r,o= /etc/bacula/bconsole.conf > > htpasswd -c /etc/apache2/webacula.users bacula > > And http://localhost/webacula I get it ... I type root and the pass > ... but then after log in ... I can see anything ... no errors ... no > message ... nothing ... a blank screen is all i got. > > Now I give chmod 777 for /var/www/webacula/data in /data I only have > /cache and a README nothing more. > > I haven't no /tmp and no /session > > I restart apache server, bacula ... and the computer too. It simply don't > work. > > I think as you ... it will be a rights issue > > > Thanks. > > > > 2011/5/25 Jérôme Blion >> Hello, >> >> Here is the list of commands I typed on the server: >> >> apt-get install php5-gd php5-mysql zendframework-bin >> cp -r webacula-5.5.rc1 /usr/share/webacula >> php /usr/share/webacula/install/check_system_requirements.php >> rm -fR /usr/share/webacula/library/Zend/ >> ln -s /usr/share/php/Zend/ /usr/share/webacula/library/Zend >> cd /usr/share/webacula/application/ >> vi config.ini >> ln -s /usr/share/webacula/install/apache/webacula.conf /etc/apache2/conf.d/ >> vi /etc/apache2/conf.d/webacula.conf >> a2enmod rewrite >> vi /etc/php5/apache2/php.ini >> vi /usr/share/webacula/install/db.conf >> cd ../install/MySql/ >> ./10_make_tables.sh >> ./20_acl_make_tables.sh >> vi ../../html/.htaccess >> chmod 777 /usr/share/webacula/data/tmp >> chmod 777 /usr/share/webacula/data/cache >> chmod 777 /usr/share/webacula/data/session >> >> Please check that you didn't forget to give enough privileges to the >> webacula/data folders... >> >> HTH. >> Jérôme Blion. >> >> Le 25/05/2011 16:26, AliKate AliKatador a écrit : >> >> Hi everybody: >> >> First of all apologize for my English. >> >> My problem: I have bacula 5.0.3 instaled (Laptop with 2.6.39-1-amd64 on >> Debian 6), it work. Bconsole too, and bat with QT interface too. >> Now I wan't to try webacula. I install webacula 5.5 ... I follow all the >> steps. I can log in http://localhost/webacula/ but then i have no grafical >> output. Nothing, nothing at all ... only a blank screen ... no more, no >> message. >> >> root@nubedebian:/usr/share/fonts# >> /var/www/webacula/install/check_system_requirements.php >> >> Webacula check System Requirements... >> >> sh: psql: not found
Re: [Bacula-users] help = Problem with webacula - no grafical output
Hello, Here is the list of commands I typed on the server: apt-get install php5-gd php5-mysql zendframework-bin cp -r webacula-5.5.rc1 /usr/share/webacula php /usr/share/webacula/install/check_system_requirements.php rm -fR /usr/share/webacula/library/Zend/ ln -s /usr/share/php/Zend/ /usr/share/webacula/library/Zend cd /usr/share/webacula/application/ vi config.ini ln -s /usr/share/webacula/install/apache/webacula.conf /etc/apache2/conf.d/ vi /etc/apache2/conf.d/webacula.conf a2enmod rewrite vi /etc/php5/apache2/php.ini vi /usr/share/webacula/install/db.conf cd ../install/MySql/ ./10_make_tables.sh ./20_acl_make_tables.sh vi ../../html/.htaccess chmod 777 /usr/share/webacula/data/tmp chmod 777 /usr/share/webacula/data/cache chmod 777 /usr/share/webacula/data/session Please check that you didn't forget to give enough privileges to the webacula/data folders... HTH. Jérôme Blion. Le 25/05/2011 16:26, AliKate AliKatador a écrit : Hi everybody: First of all apologize for my English. My problem: I have bacula 5.0.3 instaled (Laptop with 2.6.39-1-amd64 on Debian 6), it work. Bconsole too, and bat with QT interface too. Now I wan't to try webacula. I install webacula 5.5 ... I follow all the steps. I can log in http://localhost/webacula/ but then i have no grafical output. Nothing, nothing at all ... only a blank screen ... no more, no message. root@nubedebian:/usr/share/fonts# /var/www/webacula/install/check_system_requirements.php Webacula check System Requirements... sh: psql: not found Current MySQL version = 5.1.57OK Current Sqlite version = 3.7.6OK Current PHP version = 5.3.6-11OK php pdo installed.OK php gd installed.OK php xml installed.OK php dom installed.OK php pdo_mysql installed.OK Warning. PHP extension pdo_pgsql not installed. Warning. PHP extension pdo_sqlite not installed. php-dom, php-xml installed.OK mod_rewrite in apache2 work's too javascript work's fine Zend Framework minimal version 1.11.5 /php-gd is also instaled What can be wrong ??? Thanks. / -- Los datos contenidos en la presente comunicación son confidenciales y se encuentran protegidos por la *L.O. 15/99 de 13 de diciembre* sobre *Protección de Datos de Carácter Personal* como datos especialmente protegidos. Si no fuese Vd. el destinatario rogamos la destruya y proceda a dar aviso inmediato al remitente, pues la utilización, conservación, comunicación o cesión de los datos contenidos en el presente correo sin el consentimiento expreso del remitente constituye una infracción grave o muy grave sancionada por la *Ley Orgánica de Protección de Datos*. -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- vRanger cuts backup time in half-while increasing security. With the market-leading solution for virtual backup and recovery, you get blazing-fast, flexible, and affordable data protection. Download your free trial now. http://p.sf.net/sfu/quest-d2dcopy1___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Client Run After Job
Le 20/05/2011 19:08, J. Echter a écrit : > Hi, > > is there a possibility to have a job run which purpose is to start a sql > server after backup again? > > as i see in the docs theres no client run after job. > > greetings > > juergen. Hello, I think you are looking for this kind of line: RunAfterJob = "/etc/bacula/scripts/delete_catalog_backup" HTH. Jérôme Blion. -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Client machine browsing only it's backups
Le 13/05/2011 18:08, John Drescher a écrit : > 2011/5/13 Paul Pathiakis: >> Hi, >> I'm new on the list and I don't know if this question has been addressed. >> I'm looking to provide an offsite backup service to my clients and I'd like >> to use Bacula as the product. (I love it for enterprise backups.) >> I have clients that would like, as part of their EDR, to send backups >> offsite to my company. This is easily done by installing a bacula-fd >> client. >> However, I don't want to incur the overhead of a backup >> operator/administrator to service these requests. I'd like the >> customer/client to be able to do this. My question is whether I can >> configure bacula BAT or the Web interface to allow the client to only see >> his site's backups? I don't want all customers to see all other customers' >> backups. >> Is there a way to do this? > There is ACL support in the client. However I am not too familiar with > that (and what it prevents access to) since I do not use it on my > network. You may want to use a separate database per client. That way > the client will only see their stuff. This however will make it harder > to manage your bacula volumes since I do not believe you can safely > use the same bacula database in more than one catalog. > > John > I would suggest you several things: - don't grant any console access from the client's servers. - use a web interface (bweb, webacula) and set up ACL in this tool. In Webacula, you can create "limited" accounts which could allow you to perform what you expect. HTH. Jerome Blion. -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Exclude from file list?
Le 12/05/2011 15:17, Dan Schaefer a écrit :
> As indicated in the following excerpt from the Bacula Manual, the list
> of included files can be contained in a separate file. I would like to
> do the same with files to be excluded. Is this not possible using the
> same method?
>
> "Any file-list item preceded by a less-than sign () will be taken to be
> a file. This file will be read on the Director's machine (see below for
> doing it on the Client machine) at the time the Job starts, and the data
> will be assumed to be a list of directories or files, one per line, to
> be included. The names should start in column 1 and should not be quoted
> even if they contain spaces. This feature allows you to modify the
> external file and change what will be saved without stopping and
> restarting Bacula as would be necessary if using the @ modifier noted
> above. For example:
>
> Include {
> Options { signature = SHA1 }
> File = " }"
>
> I tried the following with no avail:
>
> Exclude {
> File = " }
>
Hello,
Something you could do is: @/etc/bacula/exclude.list
--
Achieve unprecedented app performance and reliability
What every C/C++ and Fortran developer should know.
Learn how Intel has extended the reach of its next-generation tools
to help boost performance applications - inlcuding clusters.
http://p.sf.net/sfu/intel-dev2devmay
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Errors with bat from windows
Le 11/05/2011 14:52, Roy Sigurd Karlsbakk a écrit : > Hi all > > We have some issues with bat not showing all backup targets with the version > browser. For this particular server, the browser only lists C: and not the > other drives backed up. I tested from X and that looks good. Testing from my > Windows VM, bat fails to see any job after the initial 41 listed, no clients > in that box, and clicking refresh returns an error: "No jobs were selected in > the job query!!!", whether I choose one or not. > > Version is 5.0.3. > > Any ideas? > > Vennlige hilsener / Best regards > > roy > -- > Roy Sigurd Karlsbakk > (+47) 97542685 > r...@karlsbakk.net > http://blogg.karlsbakk.net/ > -- Hello, I would have another question. Is there a way to generate crash reports from BAT ? It's crashing all the time anytime I try it. Best regards. Jerome Blion. -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Fileset generated by awk
Le 10/05/2011 11:56, Jérôme Blion a écrit :
Hello,
I have to backup machines which have been configured different ways
for the same feature. In fact, I want to backup mysql binlogs on a
hourly basis.
binlogs can be located at different locations:
/home/mysql
/usr/local/mysql/data
/home/binlogs
Depending on the client.
If I use the following Fileset directive,
FileSet {
Name = "Mysql Binlogs"
Include {
Options {
signature = MD5
wildfile = "*-bin.*"
}
Options {
Regex = ".*"
Exclude = yes
}
File = "/home/mysql"
File = "/home/binlogs"
File = "/usr/local/mysql/data"
}
Ignore Fileset Changes = yes
}
the backup log contains:
10-mai 05:17 tucana-dir JobId 117: Start Backup JobId 117,
Job=Backup_aquila1_binlogs.2011-05-10_05.17.00_46
10-mai 05:17 tucana-dir JobId 117: Using Device "FileStorage"
10-mai 05:17 tucana-dir JobId 117: Sending Accurate information.
10-mai 05:17 aquila1-fd JobId 117: Could not stat
"/home/binlogs": ERR=No such file or directory
10-mai 05:17 aquila1-fd JobId 117: Could not stat
"/usr/local/mysql/data": ERR=No such file or directory
10-mai 05:17 tucana-sd JobId 117: Job write elapsed time = 00:00:03,
Transfer rate = 5.502 M Bytes/second
10-mai 05:17 tucana-dir JobId 117: Bacula tucana-dir 5.0.2 (28Apr10):
10-mai-2011 05:17:06
[...]
Non-fatal FD errors:2
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination:Backup OK -- with warnings
I would like to tune my Fileset definition to avoid these non-fatal
errors.
If I run the following command on the client, I'm sure to get the
correct path to backup:
`awk '{ if($1 ~ /^log[-_]bin/ && NF==3) logfile=$3; else if($1 ~
/^datadir/) datadir=$3 } END { if (logfile != NULL) print "dirname "
logfile; else print "echo " datadir }' /etc/mysql/my.cnf`
I created /tmp/binlogs.sh:
8<--
#!/bin/bash
`awk '{ if($1 ~ /^log[-_]bin/ && NF==3) logfile=$3; else if($1 ~
/^datadir/) datadir=$3 } END { if (logfile != NULL) print "dirname "
logfile; else print "echo " datadir }' /etc/mysql/my.cnf`
--->8
If I set File = "\\| /tmp/binlogs.sh" the backup runs fine.
I would like to use the awk command directly in the Fileset directive.
Any time I use a backquote, the command fails and my backup does not work.
My last attempt was: File = "\\| bash -c \"`/usr/bin/awk '{ if(\$1 ~
/^log[-_]bin/ && NF==3) logfile=\$3; else if(\$1 ~ /^datadir/)
datadir=\$3 } END { if (logfile != NULL) print \"dirname \" logfile;
else print \"echo \" datadir }' /etc/mysql/my.cnf`\""
I tried with: File = "\\| bash -c \"\`/usr/bin/awk '/datadir/ {print
\"echo \" \$3}' /etc/mysql/my.cnf\`\" " without success.
aquila1:~# bash -c "`/usr/bin/awk '/datadir/ {print "echo " $3}'
/etc/mysql/my.cnf`"
/home/mysql
aquila1:~# bash -c "`awk '{ if($1 ~ /^log[-_]bin/ && NF==3)
logfile=$3; else if($1 ~ /^datadir/) datadir=$3 } END { if (logfile !=
NULL) print "dirname " logfile; else print "echo " datadir }'
/etc/mysql/my.cnf`"
/home/mysql
10-mai 11:17 aquila1-fd JobId 149: Fatal error: Error running program:
bash -c "`/usr/bin/awk '/datadir/ {print "echo " $3}'
/etc/mysql/my.cnf`". stat=2: ERR=Child exited with code 2
10-mai 10:31 aquila1-fd JobId 144: Fatal error: Error running program:
bash -c "`/usr/bin/awk '{ if($1 ~ /^log[-_]bin/ && NF==3) logfile=$3;
else if($1 ~ /^datadir/) datadir=$3 } END { if (logfile != NULL) print
"dirname " logfile; else print "echo " datadir }' /etc/mysql/my.cnf`".
stat=2: ERR=Child exited with code 2
What could I try to perform what I want ?
Best regards.
Jerome Blion.
As usual, I found the solution just after sending this mail:
FileSet {
Name = "Mysql Binlogs"
Include {
Options {
signature = MD5
wildfile = "*-bin.*"
}
Options {
Regex = ".*"
Exclude = yes
}
File = "\\| awk '{ if(\$1 ~ /^log[-_]bin/ && NF==3) lf=\$3; else
if(\$1 ~ /^datadir/) dd=\$3 } END { if (lf != NULL) system(\"dirname \"
lf); else system(\"echo \" dd) }' /etc/mysql/my.cnf"
}
Ignore Fileset Changes = yes
}
HTH.
Jérôme Blion.
--
Achieve unprecedented app performance and reliability
What every C/C++ and Fortran developer should know.
Learn how Intel has extended the reach of its next-generation tools
to help boost performance applications - inlcuding clusters.
http://p.sf.net/sfu/intel-dev2devmay___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Fileset generated by awk
Hello,
I have to backup machines which have been configured different ways for
the same feature. In fact, I want to backup mysql binlogs on a hourly basis.
binlogs can be located at different locations:
/home/mysql
/usr/local/mysql/data
/home/binlogs
Depending on the client.
If I use the following Fileset directive,
FileSet {
Name = "Mysql Binlogs"
Include {
Options {
signature = MD5
wildfile = "*-bin.*"
}
Options {
Regex = ".*"
Exclude = yes
}
File = "/home/mysql"
File = "/home/binlogs"
File = "/usr/local/mysql/data"
}
Ignore Fileset Changes = yes
}
the backup log contains:
10-mai 05:17 tucana-dir JobId 117: Start Backup JobId 117,
Job=Backup_aquila1_binlogs.2011-05-10_05.17.00_46
10-mai 05:17 tucana-dir JobId 117: Using Device "FileStorage"
10-mai 05:17 tucana-dir JobId 117: Sending Accurate information.
10-mai 05:17 aquila1-fd JobId 117: Could not stat "/home/binlogs":
ERR=No such file or directory
10-mai 05:17 aquila1-fd JobId 117: Could not stat
"/usr/local/mysql/data": ERR=No such file or directory
10-mai 05:17 tucana-sd JobId 117: Job write elapsed time = 00:00:03,
Transfer rate = 5.502 M Bytes/second
10-mai 05:17 tucana-dir JobId 117: Bacula tucana-dir 5.0.2 (28Apr10):
10-mai-2011 05:17:06
[...]
Non-fatal FD errors:2
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination:Backup OK -- with warnings
I would like to tune my Fileset definition to avoid these non-fatal errors.
If I run the following command on the client, I'm sure to get the
correct path to backup:
`awk '{ if($1 ~ /^log[-_]bin/ && NF==3) logfile=$3; else if($1 ~
/^datadir/) datadir=$3 } END { if (logfile != NULL) print "dirname "
logfile; else print "echo " datadir }' /etc/mysql/my.cnf`
I created /tmp/binlogs.sh:
8<--
#!/bin/bash
`awk '{ if($1 ~ /^log[-_]bin/ && NF==3) logfile=$3; else if($1 ~
/^datadir/) datadir=$3 } END { if (logfile != NULL) print "dirname "
logfile; else print "echo " datadir }' /etc/mysql/my.cnf`
--->8
If I set File = "\\| /tmp/binlogs.sh" the backup runs fine.
I would like to use the awk command directly in the Fileset directive.
Any time I use a backquote, the command fails and my backup does not work.
My last attempt was: File = "\\| bash -c \"`/usr/bin/awk '{ if(\$1 ~
/^log[-_]bin/ && NF==3) logfile=\$3; else if(\$1 ~ /^datadir/)
datadir=\$3 } END { if (logfile != NULL) print \"dirname \" logfile;
else print \"echo \" datadir }' /etc/mysql/my.cnf`\""
I tried with: File = "\\| bash -c \"\`/usr/bin/awk '/datadir/ {print
\"echo \" \$3}' /etc/mysql/my.cnf\`\" " without success.
aquila1:~# bash -c "`/usr/bin/awk '/datadir/ {print "echo " $3}'
/etc/mysql/my.cnf`"
/home/mysql
aquila1:~# bash -c "`awk '{ if($1 ~ /^log[-_]bin/ && NF==3) logfile=$3;
else if($1 ~ /^datadir/) datadir=$3 } END { if (logfile != NULL) print
"dirname " logfile; else print "echo " datadir }' /etc/mysql/my.cnf`"
/home/mysql
10-mai 11:17 aquila1-fd JobId 149: Fatal error: Error running program:
bash -c "`/usr/bin/awk '/datadir/ {print "echo " $3}'
/etc/mysql/my.cnf`". stat=2: ERR=Child exited with code 2
10-mai 10:31 aquila1-fd JobId 144: Fatal error: Error running program:
bash -c "`/usr/bin/awk '{ if($1 ~ /^log[-_]bin/ && NF==3) logfile=$3;
else if($1 ~ /^datadir/) datadir=$3 } END { if (logfile != NULL) print
"dirname " logfile; else print "echo " datadir }' /etc/mysql/my.cnf`".
stat=2: ERR=Child exited with code 2
What could I try to perform what I want ?
Best regards.
Jerome Blion.
--
Achieve unprecedented app performance and reliability
What every C/C++ and Fortran developer should know.
Learn how Intel has extended the reach of its next-generation tools
to help boost performance applications - inlcuding clusters.
http://p.sf.net/sfu/intel-dev2devmay___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] error message in runbefore job
Le 04/05/2011 14:40, Konstantin Khomoutov a écrit :
> On Wed, 04 May 2011 13:23:55 +0200
> Joris Heinrich wrote
>> i run an job with an mysql backup and an ClientRunBeforeJob like this
>> example:
>>
>>
>> Job {
>> Name= test-client
>> Client = tool-client
>> JobDefs = dbdump
>> FileSet = db
>> ClientRunBeforeJob = "/etc/bacula/scripts/manage_mysql_backup"
>>
>> In the client script, is included an ssh connect to various other
>> machines. Some machines are new installed, and the host-verification
>> will be fail:
>>
>> 04-May 01:00 tool-client JobId 291204: ClientRunBeforeJob: Host key
>> verification failed.
>>
>> The bacula job it self brings an OK Message per email.
>>
>> Now my qestion, it is possible to parse the message and change the
>> job-status to error or warning..
> Create another script, say,
> /etc/bacula/scripts/manage_mysql_backup2
> which should look like this:
>
> #!/bin/sh
> /etc/bacula/scripts/manage_mysql_backup 2>&1 \
>| grep "verification failed"&& exit 1
>
> Then use the new wrapper script for ClientRunBeforeJob.
> Now if the original script generates that error message, the wrapper
> script would exit with non-zero code, failing the job.
Hello,
The workaround if far than enough.
The real solution is to modify the script to end with an exit code
greater than 0 when something wrong happens.
It means you will have to modify the script to manage all possible errors.
HTH.
Jerome Blion.
--
WhatsUp Gold - Download Free Network Management Software
The most intuitive, comprehensive, and cost-effective network
management toolset available today. Delivers lowest initial
acquisition cost and overall TCO of any competing solution.
http://p.sf.net/sfu/whatsupgold-sd
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] About retention, and pruning.
On Thu, 28 Apr 2011 17:33:48 +0200, Hugo Letemplier wrote: > After the job ran many times: I have the following volume <=> job matching > Vol name Level Time > Test1 Full15:50 > 324Inc 16:00 > 325Inc 16:10 > 326Inc 16:20 > 324Inc 16:30 > Test2 Full16:40 > 325Inc 16:50 > 326Inc 17:00 > > This is problematic because Vol324 is recycled instead of creating a new > one > I am not sure to understand the various retention periods : File, job, > volume > I think that I can increase the retention times but the problem will > always be the same. > ex : if I keep my incremental one hour then my first ones will always > be purged first > In a good strategy you purge the full sequence of incremental at the > same time because you need to recycle you volume and don't want to > keep a recent volume (incremental) without the previous ones. You would waste your tape/disk space. > To do that I imagine that I need to create one pool per day and reduce > progressively the retention periods. It doesn't makes sense ! > I turned the problem on all its sides but I cant find a good > solution. Maybe the other retention period are the solution but I > didn't succeeded ? > Thanks in advance That means that your upper backup levels should have greater retentions to be sure that at any time, you can use the full + diff + inc if needed. Keeping incremental without full backup can be useful to restore only specific files. HTH. Jérôme Blion. -- WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem "rejected Hello command" with DIR 2.2.6 and FD 5.0.2
Le 21/04/2011 00:05, John Drescher a écrit : > On Wed, Apr 20, 2011 at 5:52 PM, Jérôme Blion wrote: >> Le 20/04/2011 16:01, Jeremy Maes a écrit : >>> Op 20/04/2011 15:29, Ben Schmidt schreef: >>>> I'm running a bacula 2.2.6 on a old Server that's just working. One of >>>> it's Clients was replaced by a new Server with debian 6.0 today and I >>>> can't get bacula running. >>>> >>>> Server: DIR: 2.2.6, SD: 2.2.6, SLES 10.1 amd64 >>>> Client: FD: 5.0.2, debian 6.0 amd64 >>>> No SSL/TLS in use. >>>> ... >>> Old dir with new clients won't work. The communications protocols have >>> been updated so the old dir doesn't know how to talk to the new client. >>> >>> The easiest solution might be to rebuild the old client on the new >>> platform, though a complete upgrade to the latest 5.0.3 might be better >>> for future-proof-ness. >>> >>> Regards, >>> Jeremy >>> >> Hello, >> >> Is there a compatibility matrix available ? >> > No but a simple rule. The server (director and storage) must be always = > client. Also the director must be the same version as the storage. > John Hello, This rule is not the real truth. I'm backing up a 2.4.4 (Debian Lenny) client on a 5.0.2 (Debian Squeeze) Director (and Storage) Does the Bacula team plan to provide such compatibility matrix ? Best regards. Jerome Blion. -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Problem "rejected Hello command" with DIR 2.2.6 and FD 5.0.2
Le 20/04/2011 16:01, Jeremy Maes a écrit : > Op 20/04/2011 15:29, Ben Schmidt schreef: >> I'm running a bacula 2.2.6 on a old Server that's just working. One of >> it's Clients was replaced by a new Server with debian 6.0 today and I >> can't get bacula running. >> >> Server: DIR: 2.2.6, SD: 2.2.6, SLES 10.1 amd64 >> Client: FD: 5.0.2, debian 6.0 amd64 >> No SSL/TLS in use. >> ... > Old dir with new clients won't work. The communications protocols have > been updated so the old dir doesn't know how to talk to the new client. > > The easiest solution might be to rebuild the old client on the new > platform, though a complete upgrade to the latest 5.0.3 might be better > for future-proof-ness. > > Regards, > Jeremy > Hello, Is there a compatibility matrix available ? HTH. Jérôme Blion. -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Job pruning
On Thu, 07 Apr 2011 23:08:38 +0200, Jérôme Blion wrote: > Le 07/04/2011 10:24, Jérôme Blion a écrit : >> Hello, >> >> That would mean there is no job retention. BackupCatalog jobs are pruned. >> So, we can have Job pruning before volume pruning. >> File, Job, Volume retentions are differents parameters. Volumes can only >> be automatically recycled if no more jobs references it. >> >> Best regards. >> Jerome Blion. >> >> >> On Wed, 6 Apr 2011 22:04:24 -0300, Rodrigo Renie Braga >> wrote: >>> The jobs will only be pruned when their respective volumes are recycled >> or >>> purged... since the Volume Retention in your Pool is 3 days, that will >>> happen at the seventh day of running backups, when the second volume >>> expires >>> and Bacula recycles the first volume... >>> >>> >>> 2011/4/6 Jérôme Blion >>> >>>> Hello, >>>> >>>> I'm setting a test infrastructure on Debian Squeeze. I'm using Debian >>>> packages (5.0.2). >>>> You can find various configuration files here: >>>> http://www.hebergement-pro.org/bacula/ >>>> >>>> I set: >>>> serveur:/home/www/www/bacula# grep Retention bacula-dir.conf.txt >>>>File Retention = 3 days >>>>Job Retention = 3 days >>>>Volume Retention = 3 days >>>>Volume Retention = 3 days >>>>File Retention = 3 days >>>> >>>> When I list jobs, I can see jobs which should have expired. Catalog >>>> backups >>>> are correctly pruned but other ones are not. >>>> Here are some outputs: >>>> >> http://www.hebergement-pro.org/bacula/output.txt<http://www.hebergement-pro.org/bacula/joblist.txt> >>>> Files backed up during these jobs cannot be listed with "list files >>>> jobid=35". I can restore the whole job successfully (as the volume has >>>> not >>>> been recycled yet) >>>> When I perform a show job=Backup_Serveur (or anyone else), I have the >>>> following strange line: JobRetention=0 secs FileRetention=11 months 16 >>>> days >>>> 4 hours 46 mins 48 secs >>>> I never set it up such retentions. What is that File Retention ? I >> don't >>>> understand it. >>>> >>>> By the past, I modified retention period. How does the pruning work ? >> is >>>> the expiration date stored into the database ? I didn't find it. >>>> How could I identify what is wrong in my setup ? >>>> >>>> Best regards. >>>> Jerome Blion. > > Hello, > > Sorry for the message on top... > To give you new inputs: > > 07-Apr 23:05 vm10-bacula-dir JobId 77: Begin pruning Jobs older than 3 > days . > 07-Apr 23:05 vm10-bacula-dir JobId 77: No Jobs found to prune. > 07-Apr 23:05 vm10-bacula-dir JobId 77: Begin pruning Jobs. > 07-Apr 23:05 vm10-bacula-dir JobId 77: Pruned Files from 2 Jobs for > client serveur-fd from catalog. > 07-Apr 23:05 vm10-bacula-dir JobId 77: End auto prune. > > Why jobs are not pruned by the system, whereas files are ? > They should be cleaned together. > > Best regards. > Jerome Blion. Hello, I totally reinstalled the bacula server. I modified all retentions before starting it. Now, files, jobs and volumes are pruned according to my directives. I think the retention period is stored into the database... I just don't know where. HTH. Jérôme Blion. -- Benefiting from Server Virtualization: Beyond Initial Workload Consolidation -- Increasing the use of server virtualization is a top priority.Virtualization can reduce costs, simplify management, and improve application availability and disaster protection. Learn more about boosting the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] force backup of unchanged file in incremental backup
On Thu, 14 Apr 2011 12:37:35 + (UTC), Thomas Mueller
wrote:
> Am Thu, 14 Apr 2011 16:33:14 +1000 schrieb James Harper:
>
>> The "last modified" datestamp on MSSQL database files doesn't get
>> changed unless the actual file dimensions change (eg it 'grows') or
when
>> the file is closed. This means that an incremental backup won't
>> necessarily back up the database files unless they have changed.
>> Accurate won't catch this either as the metadata it uses will be
>> identical.
>>
>> Is there a way to force the backup of specific unchanged files during
an
>> incremental or differential backup? Eg:
>>
>> Option {
>> File = "C:/database/mydb.mdf"
>> Always Back Up = Yes
>> }
>>
>
> you could create a backup job with just that file in it and run it
always
> as full.
>
> - Thomas
I think his goal is to recreate some differential backups for MSSQL (RMAN
provides it for Oracle).
To do that, he needs to know which datafiles moved... If you perform a
touch on each of them, it's not a differential backup but a full one.
Are we sure that all data pieces have been flushed to disk before the VSS
snapshot occurred ?
HTH.
Jerome Blion.
--
Benefiting from Server Virtualization: Beyond Initial Workload
Consolidation -- Increasing the use of server virtualization is a top
priority.Virtualization can reduce costs, simplify management, and improve
application availability and disaster protection. Learn more about boosting
the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] force backup of unchanged file in incremental backup
On Thu, 14 Apr 2011 09:54:09 +0200, Christian Manal
wrote:
> Am 14.04.2011 08:33, schrieb James Harper:
>> The "last modified" datestamp on MSSQL database files doesn't get
>> changed unless the actual file dimensions change (eg it 'grows') or
when
>> the file is closed. This means that an incremental backup won't
>> necessarily back up the database files unless they have changed.
>> Accurate won't catch this either as the metadata it uses will be
>> identical.
>>
>> Is there a way to force the backup of specific unchanged files during
an
>> incremental or differential backup? Eg:
>>
>> Option {
>> File = "C:/database/mydb.mdf"
>> Always Back Up = Yes
>> }
>>
>> Thanks
>>
>> James
>
> Hi,
>
> does the file change at all? If so, you can just adjust the metadata
> that Accurate uses to compare checksums. That is done in the fileset:
>
>
http://bacula.org/5.0.x-manuals/en/main/main/Configuring_Director.html#8553
>
>
> Regards,
> Christian Manal
>
Hello,
AFAIK, you should never backup MSSQL databases when they are running. If
you do so, the database will try to recover from a crash and you can loose
data pieces. Files do not reflect the status of the database.
You should back it up correctly, using a database agent (eg: Litespeed) or
SQL scripts to dump it then archive it.
If you do so, you will be able to backup transaction log too and will be
able to perform PIT restores.
You could start from the catalog backup job to adapt it to your needs.
For Mysql, there is one interesting way : flush tables with read lock +
LVM snapshot. Files are coherent, and backed up at the exact same time.
Perhaps you could use a similar way to backup database's files.
HTH.
Jerome Blion.
--
Benefiting from Server Virtualization: Beyond Initial Workload
Consolidation -- Increasing the use of server virtualization is a top
priority.Virtualization can reduce costs, simplify management, and improve
application availability and disaster protection. Learn more about boosting
the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Connection error from remote client
On Wed, 13 Apr 2011 18:45:51 -0400, "Kenney, William P. (Information
Technology Services)" wrote:
>> -Original Message-
>> From: Jérôme Blion [mailto:jerome.bl...@free.fr]
>> Sent: Friday, April 08, 2011 9:55 AM
>> To: Kenney, William P. (Information Technology Services)
>> Cc: bacula-users@lists.sourceforge.net
>> Subject: RE: [Bacula-users] Connection error from remote client
> clip
>
>> > I have tried this address, ecsu-bk3.easternct.edu and the IP address
>> in
>> > the address field and get the same error.
>> >
>> > I have removed the internal FW's during testing and it made no
>> difference.
>> >
>> > The database contains a bacula user for all hostname addresses that I
>> have
>> > used, so that should not be a problem.
>> >
>> > Bill
>>
>> Hello,
>>
>> From the client, are the following commands working?
>> nslookup ecsu-bk3
>> telnet ecsu-bk3 9103
>>
>> Can you confirm me the Storage Daemon and the Director are on the same
>> machine?
>>
>> (I read ecsu-bk3-dir in your message)
>>
>> HTH.
>> Jerome Blion.
>
> Hi Jerome,
>
> I cleaned up the DNS server annow get only one "correct" response from
> nslookup.
>
> The Storage daemon and Director are on the same machine.
>
> I opened up "my.cnf" to allow remote access to the database.
>
> I added the FQDN and alias to the IP address in the /etc/hosts file.
>
> The local client runs just fine but I still get the error message from
the
> second "remote" client.
>
> Below is a listing of the error message and the configuration files I'm
> using:
>
>
*
> This is the error message I received from the Director:
>
> You have messages.
> *messages
> 13-Apr 18:11 ecsu-bk3-dir JobId 55: Fatal error: No Job status returned
> from FD.
> 13-Apr 18:08 ecsu-bk3-dir JobId 55: Warning: bsock.c:129 Could not
connect
> to Client: beast-fd on beast.easternct.edu:9102. ERR=Connection refused
> Retrying ...
> 13-Apr 18:11 ecsu-bk3-dir JobId 55: Fatal error: bsock.c:135 Unable to
> connect to Client: beast-fd on beast.easternct.edu:9102. ERR=Connection
> refused
> 13-Apr 18:11 ecsu-bk3-dir JobId 55: Error: Bacula ecsu-bk3-dir 5.0.2
> (28Apr10): 13-Apr-2011 18:11:00
> Build OS: x86_64-pc-linux-gnu ubuntu 10.10
> JobId: 55
> Job:BackupClient2.2011-04-13_18.07.58_12
> Backup Level: Full (upgraded from Incremental)
> Client: "beast-fd" 5.0.0 (26Jan10)
> x86_64-redhat-linux-gnu,redhat,Enterprise release
> FileSet:"Full Set" 2011-04-01 11:44:48
> Pool: "File" (From Job resource)
> Catalog:"MyCatalog" (From Client resource)
> Storage:"File" (From Job resource)
> Scheduled time: 13-Apr-2011 18:07:51
> Start time: 13-Apr-2011 18:08:00
> End time: 13-Apr-2011 18:11:00
> Elapsed time: 3 mins
> Priority: 10
> FD Files Written: 0
> SD Files Written: 0
> FD Bytes Written: 0 (0 B)
> SD Bytes Written: 0 (0 B)
> Rate: 0.0 KB/s
> Software Compression: None
> VSS:no
> Encryption: no
> Accurate: no
> Volume name(s):
> Volume Session Id: 3
> Volume Session Time:1302731375
> Last Volume Bytes: 1,774 (1.774 KB)
> Non-fatal FD errors:0
> SD Errors: 0
> FD termination status: Error
> SD termination status: Waiting on FD
> Termination:*** Backup Error ***
>
> [...]
>
> This is the bacula-sd.conf on the backup server
>
> #
> # Default Bacula Storage Daemon Configuration file
> #
> # For Bacula release 5.0.2 (28 April 2010) -- ubuntu 10.10
> #
> # You may need to change the name of your tape drive
> # on the "Archive Device" directive in the Device
> # resource. If you change the Name and/or the
> # "Media Type" in the Device resource, please ensure
> # that dird.conf has corresponding changes.
> #
>
> Storage { # definition of myself
> Name = ecsu-bk3-sd
> SDPort = 9103 # Director's port
> WorkingDirectory = "/var/lib/bacula"
> Pid Directory = "/var/run/bacula"
> Maximum Concur
Re: [Bacula-users] Backup will not started
On Tue, 12 Apr 2011 10:27:04 +0200, Luca Bertoncello wrote: > Hi, list! > > I use Bacula to backup 4 Servers in the network of my office. > > Today (full backup of all Servers!) Bacula didn't start. > I can see the Backups are "pending" using bat (a Bacula administration > tool for KDE), but no Bytes are send through the net. > > Can you help me to find the problem? Where can I search for a log entry > with a message about the problem? > > Thanks a lot! Hello, from bconsole: status director status storage list jobs In your bacula-dir.conf file, in messages section, you should be able to see something like append = /var/log/bacula/log Perhaps you will be able to see some interesting things HTH. Jerome Blion. -- Forrester Wave Report - Recovery time is now measured in hours and minutes not days. Key insights are discussed in the 2010 Forrester Wave Report as part of an in-depth evaluation of disaster recovery service providers. Forrester found the best-in-class provider in terms of services and vision. Read this report now! http://p.sf.net/sfu/ibm-webcastpromo ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
