Dear bareos community,
I cannot find the error in my Always incremental configuration (using bareos
17.2.4).
Whenever a VirtualFull (serv1_nc) runs into the AI backup window (e.g.
consolidating a full), my Always Incrementals of the same client are waiting
until the VirtualFull is finished.
Jobid 3573 (AI job which should not wait) seems to be busy reading (status
reports from both storages), but it is not advancing.
I get the following status reports when Virtualfull is running and AI is
waiting:
======= S T A T U S DIRECTOR =======
Director:
3569 Virtual serv1_nc.2018-03-14_10.00.03_28 is running
3570 Virtual serv2_sys_ai.2018-03-14_10.00.04_29 is waiting on Storage
"bareos-file-consolidate"
3571 Virtual serv3_sys_ai.2018-03-14_10.00.04_30 is waiting on max Storage
jobs
3572 Virtual serv4_sys_ai.2018-03-14_10.00.05_31 is waiting on max Storage
jobs
3573 Increme serv1_nc.2018-03-14_12.00.01_06 is waiting on Storage
"bareos-file" <<-- this job should NOT wait
3575 Increme serv1_nc.2018-03-14_16.00.00_18 is waiting on max Client jobs
3576 VolumeT serv5_v.2018-03-14_16.09.10_21 is waiting on max Client jobs
======= S T A T U S DIRECTOR =======
======= S T A T U S STORAGE bareos-file-consolidate =======
Connecting to Storage daemon bareos-file-consolidate at bareos-sd:9103
bareos-sd Version: 17.2.4 (21 Sep 2017) x86_64-pc-linux-gnu ubuntu Ubuntu 16.04
LTS
Daemon started 13-Mar-18 14:48. Jobs: run=18, running=2.
Heap: heap=135,168 smbytes=1,399,275 max_bytes=1,456,452 bufs=2,595
max_bufs=2,597
Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 mode=0 bwlimit=0kB/s
Running Jobs:
Reading: Virtual Full Backup job serv1_nc JobId=3569
Volume="ai_consolidate-0075"
pool="disk_ai" device="bareos-file" (/mnt/archive/bareos)
Writing: Virtual Full Backup job serv1_nc JobId=3569
Volume="ai_consolidate-0140"
pool="disk_ai_consolidate" device="bareos-file-consolidate"
(/mnt/archive/bareos)
spooling=0 despooling=0 despool_wait=0
Files=134,641 Bytes=137,689,824,687 AveBytes/sec=13,436,246
LastBytes/sec=16,859,913
FDSocket closed
Reading: Virtual Full Backup job serv3_sys_ai JobId=3570 Volume=""
pool="disk_ai" device="bareos-file" (/mnt/archive/bareos)
Writing: Virtual Full Backup job serv3_sys_ai JobId=3570 Volume=""
pool="disk_ai" device="bareos-file" (/mnt/archive/bareos)
spooling=0 despooling=0 despool_wait=0
Files=0 Bytes=0 AveBytes/sec=0 LastBytes/sec=0
FDSocket closed
Writing: Incremental Backup job serv1_nc JobId=3573 Volume="ai_consolidate-0140"
pool="disk_ai" device="bareos-file" (/mnt/archive/bareos)
spooling=0 despooling=0 despool_wait=0
Files=0 Bytes=0 AveBytes/sec=0 LastBytes/sec=0
FDSocket closed
====
Jobs waiting to reserve a drive:
3602 JobId=3570 device "bareos-file" (/mnt/archive/bareos) is busy (already
reading/writing).
3603 JobId=3573 device "bareos-file" (/mnt/archive/bareos) is busy reading.
====
Terminated Jobs:
JobId Level Files Bytes Status Finished Name
===================================================================
3554 Incr 172 433.6 M OK 13-Mar-18 19:01 serv1_sys_ai
3555 0 0 OK 13-Mar-18 19:01 serv1_sys_ai_v
3558 Incr 212 59.82 M OK 13-Mar-18 20:01 serv1_nc
3559 0 0 OK 13-Mar-18 20:01 serv1_nc_ai_v
3560 Incr 242 199.8 M OK 13-Mar-18 20:30 servX_sys_ai
3561 0 0 OK 13-Mar-18 20:30 servX_sys_ai_v
3562 Incr 12 529.2 K OK 14-Mar-18 00:01 serv1_nc
3563 0 0 OK 14-Mar-18 00:01 serv1_nc_ai_v
3564 Incr 0 0 OK 14-Mar-18 04:01 serv1_nc
3566 Incr 0 0 OK 14-Mar-18 08:01 serv1_nc
====
Device status:
Device "bareos-file-consolidate" (/mnt/archive/bareos) is mounted with:
Volume: ai_consolidate-0140
Pool: disk_ai_consolidate
Media type: File
Total Bytes=8,953,749,554 Blocks=138,792 Bytes/block=64,512
Positioned at File=2 Block=363,814,961
==
====
Used Volume status:
ai_consolidate-0140 on device "bareos-file-consolidate" (/mnt/archive/bareos)
Reader=0 writers=1 reserves=0 volinuse=1
Volume: ai_consolidate-0023 no device. volinuse= 0
Volume: ai_consolidate-0075 no device. volinuse= 0
Volume: ai_consolidate-0078 no device. volinuse= 0
Volume: ai_consolidate-0079 no device. volinuse= 0
Volume: ai_consolidate-0093 no device. volinuse= 0
Volume: ai_consolidate-0098 no device. volinuse= 0
Volume: ai_consolidate-0107 no device. volinuse= 0
Volume: ai_consolidate-0108 no device. volinuse= 0
Volume: ai_consolidate-0109 no device. volinuse= 0
Volume: ai_consolidate-0112 no device. volinuse= 0
Volume: ai_consolidate-0116 no device. volinuse= 0
Volume: ai_inc-0047 no device. volinuse= 0
Volume: ai_consolidate-0112 no device. volinuse= 0
Volume: ai_consolidate-0133 no device. volinuse= 0
Volume: ai_inc-0047 no device. volinuse= 0
====
======= S T A T U S STORAGE bareos-file-consolidate =======
======= S T A T U S STORAGE bareos-file =======
Connecting to Storage daemon bareos-file at bareos-sd:9103
bareos-sd Version: 17.2.4 (21 Sep 2017) x86_64-pc-linux-gnu ubuntu Ubuntu 16.04
LTS
Daemon started 13-Mar-18 14:48. Jobs: run=18, running=2.
Heap: heap=135,168 smbytes=1,396,777 max_bytes=1,456,452 bufs=2,593
max_bufs=2,594
Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 mode=0 bwlimit=0kB/s
Running Jobs:
Reading: Virtual Full Backup job serv1_nc JobId=3569
Volume="ai_consolidate-0075"
pool="disk_ai" device="bareos-file" (/mnt/archive/bareos)
Writing: Virtual Full Backup job serv1_nc JobId=3569
Volume="ai_consolidate-0140"
pool="disk_ai_consolidate" device="bareos-file-consolidate"
(/mnt/archive/bareos)
spooling=0 despooling=0 despool_wait=0
Files=134,570 Bytes=137,672,964,774 AveBytes/sec=10,012,579
LastBytes/sec=10,012,579
FDSocket closed
Reading: Virtual Full Backup job serv3_sys_ai JobId=3570 Volume=""
pool="disk_ai" device="bareos-file" (/mnt/archive/bareos)
Writing: Virtual Full Backup job serv3_sys_ai JobId=3570 Volume=""
pool="disk_ai" device="bareos-file" (/mnt/archive/bareos)
spooling=0 despooling=0 despool_wait=0
Files=0 Bytes=0 AveBytes/sec=0 LastBytes/sec=0
FDSocket closed
Writing: Incremental Backup job serv1_nc JobId=3573 Volume="ai_consolidate-0140"
pool="disk_ai" device="bareos-file" (/mnt/archive/bareos)
spooling=0 despooling=0 despool_wait=0
Files=0 Bytes=0 AveBytes/sec=0 LastBytes/sec=0
FDSocket closed
====
Jobs waiting to reserve a drive:
3602 JobId=3570 device "bareos-file" (/mnt/archive/bareos) is busy (already
reading/writing).
3603 JobId=3573 device "bareos-file" (/mnt/archive/bareos) is busy reading.
====
Terminated Jobs:
JobId Level Files Bytes Status Finished Name
===================================================================
3554 Incr 172 433.6 M OK 13-Mar-18 19:01 serv1_sys_ai
3555 0 0 OK 13-Mar-18 19:01 serv1_sys_ai_v
3558 Incr 212 59.82 M OK 13-Mar-18 20:01 serv1_nc
3559 0 0 OK 13-Mar-18 20:01 serv1_nc_ai_v
3560 Incr 242 199.8 M OK 13-Mar-18 20:30 serv2_sys_ai
3561 0 0 OK 13-Mar-18 20:30 serv2_sys_ai_v
3562 Incr 12 529.2 K OK 14-Mar-18 00:01 serv1_nc
3563 0 0 OK 14-Mar-18 00:01 serv1_nc_ai_v
3564 Incr 0 0 OK 14-Mar-18 04:01 serv1_nc
3566 Incr 0 0 OK 14-Mar-18 08:01 serv1_nc
====
Device status:
Device "bareos-file" (/mnt/archive/bareos) is mounted with:
Volume: ai_consolidate-0075
Pool: disk_ai
Media type: File
Total Bytes Read=9,391,398,912 Blocks Read=145,576 Bytes/block=64,512
Positioned at File=2 Block=801,399,867
==
====
Used Volume status:
ai_consolidate-0075 on device "bareos-file" (/mnt/archive/bareos)
Reader=1 writers=0 reserves=0 volinuse=1
Volume: ai_consolidate-0023 no device. volinuse= 0
Volume: ai_consolidate-0075 no device. volinuse= 0
Volume: ai_consolidate-0078 no device. volinuse= 0
Volume: ai_consolidate-0079 no device. volinuse= 0
Volume: ai_consolidate-0093 no device. volinuse= 0
Volume: ai_consolidate-0098 no device. volinuse= 0
Volume: ai_consolidate-0107 no device. volinuse= 0
Volume: ai_consolidate-0108 no device. volinuse= 0
Volume: ai_consolidate-0109 no device. volinuse= 0
Volume: ai_consolidate-0112 no device. volinuse= 0
Volume: ai_consolidate-0116 no device. volinuse= 0
Volume: ai_inc-0047 no device. volinuse= 0
Volume: ai_consolidate-0112 no device. volinuse= 0
Volume: ai_consolidate-0133 no device. volinuse= 0
Volume: ai_inc-0047 no device. volinuse= 0
====
======= S T A T U S STORAGE bareos-file =======
======= C O N F I G U R A T I O N =======
=== DIRECTOR ===
Client {
Name = serv1-fd
Maximum Concurrent Jobs = 2
Address = serv1.xx.xx.
Password = XXXX
TLS Certificate = XXX
TLS Key = XXX
TLS CA Certificate File = XXX
TLS DH File = XXXX
TLS Enable = XXX
TLS Require = XXX
TLS Verify Peer = XXX
TLS Allowed CN = XXX
}
Director { # define myself
Name = bareos-dir
QueryFile = "/usr/lib/bareos/scripts/query.sql"
Maximum Concurrent Jobs = 10
Password = XXXX
Messages = Daemon
Auditing = yes
.... (TLS config) ...
}
Job {
Name = ai_consolidate
Type = Consolidate
Accurate = yes
Max Full Consolidations = 2
Client = bareos-fd
FileSet = "none"
Pool = disk_ai_consolidate
Priority = 9
Allow Mixed Priority = yes
Full Backup Pool = disk_ai_consolidate
Level = Full
Schedule = XXX
Storage = bareos-file
Messages = Standard
}
Job {
Name = "serv1_nc"
JobDefs = "default_ai"
Client = "serv1-fd"
FileSet = XXXX
Schedule = XXXX
#Always Incremental adaptations
Always Incremental Keep Number = 34
}
JobDefs {
Name = "default_ai"
Type = Backup
Level = Incremental
Client = bareos-fd
Messages = Standard
Priority = 10
Maximum Concurrent Jobs = 7
Allow Mixed Priority = yes
#Allow Duplicate Jobs = no #doesn't work with virtualFull Job
#Cancel Lower Level Duplicates = yes
#Cancel Queued Duplicates = yes
#always incremental config
Pool = disk_ai
#Incremental Backup Pool = disk_ai
Full Backup Pool = disk_ai_consolidate
Storage = bareos-file
Accurate = yes
Always Incremental = yes
Always Incremental Job Retention = 7 days
Always Incremental Keep Number = 7
Always Incremental Max Full Age = 14 days
}
Pool {
Name = disk_ai
Pool Type = Backup
Recycle = yes # Bareos can automatically recycle Volumes
AutoPrune = yes # Prune expired volumes
Volume Retention = 4 weeks
Maximum Volume Bytes = 30G # Limit Volume size to something
reasonable
Maximum Volumes = 200 # Limit number of Volumes in Pool
Label Format = "ai_inc-" # Volumes will be labeled
"Full-<volume-id>"
Volume Use Duration = 23h
Storage = bareos-file
Next Pool = disk_ai_consolidate
}
~
Pool {
Name = disk_ai_consolidate
Pool Type = Backup
Recycle = yes # Bareos can automatically recycle Volumes
AutoPrune = yes # Prune expired volumes
Volume Retention = 4 weeks
Maximum Volume Bytes = 30G # Limit Volume size to something
reasonable
Maximum Volumes = 200 # Limit number of Volumes in Pool
Label Format = "ai_consolidate-" # Volumes will be labeled
"Full-<volume-id>"
Volume Use Duration = 23h
Storage = bareos-file-consolidate #virtualfull test
}
Storage {
Name = bareos-file
Address = XXXX
Password = XXXX
Maximum Concurrent Jobs = 7
Device = bareos-file
Media Type = File
TLS Certificate =
TLS Key =
TLS CA Certificate File =
TLS DH File =
TLS Enable = yes
TLS Require = yes
TLS Verify Peer = yes
TLS Allowed CN =
}
Storage {
Name = bareos-file-consolidate
Address =
Password = XXXX
Maximum Concurrent Jobs = 7
Device = bareos-file-consolidate
Media Type = File
TLS Certificate =
TLS Key =
TLS CA Certificate File =
TLS DH File =
TLS Enable = yes
TLS Require = yes
TLS Verify Peer = yes
TLS Allowed CN =
}
=== STORAGE ===
Device {
Name = bareos-file
Media Type = File
Maximum Open Volumes = 3
Maximum Concurrent Jobs = 7
Archive Device = XXX
LabelMedia = yes; # lets Bareos label unlabeled media
Random Access = yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = no;
AlwaysOpen = no;
Description = "File device. A connecting Director must have the same Name and
MediaType."
}
Device {
Name = bareos-file-consolidate
Media Type = File
Maximum Open Volumes = 3
Maximum Concurrent Jobs = 7
Archive Device = XXXX
LabelMedia = yes; # lets Bareos label unlabeled media
Random Access = yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = no;
AlwaysOpen = no;
Description = "File device. A connecting Director must have the same Name and
MediaType."
}
Storage {
Name = bareos-sd
Maximum Concurrent Jobs = 20
# remove comment from "Plugin Directory" to load plugins from specified
directory.
# if "Plugin Names" is defined, only the specified plugins will be loaded,
# otherwise all storage plugins (*-sd.so) from the "Plugin Directory".
#
Plugin Directory = /usr/lib/bareos/plugins
Plugin Names = "bpipe"
TLS Certificate =xxxx
TLS Allowed CN = xxx
}
=== CLIENT ===
Client {
Name = serv1-fd
Maximum Concurrent Jobs = 20
.....
}
======= C O N F I G U R A T I O N =======
--
You received this message because you are subscribed to the Google Groups
"bareos-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
For more options, visit https://groups.google.com/d/optout.
