Re: [Bacula-users] Incremental changed to Full

[Dan Langille]

> On Sep 11, 2017, at 10:54 AM, Maciolek, Mark  wrote:
>  
> Hi,
>  
> The full took over 5 days (47Tb) so job 17 was in the schedule before it 
> finished, so I should change my schedule to do a Full the first Sunday of the 
> month and then only incremental starting on the second Sunday of the month?

Instead, I would use the Duplicate job directives previously mentioned.
-- 
Dan Langille - BSDCan / PGCon
d...@langille.org



--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Fw: Aw: Re: Renamed and moved files are backed up again

[Radosław Korzeniewski]

Hello,

2017-09-06 10:01 GMT+02:00 Roberts, Ben :

> Hi Fabian,
>
>
>
> Others on the list may correct me if I’m wrong, but fundamentally Bacula
> treats different filenames as different entities to be backed up,
> regardless of content being shared across multiple files. The flags you
> have been changing only relax the checks for a given filename to see
> whether it should be backed up or not based on changes to content or
> metadata. Renaming or moving a file will cause the object to be backed up
> under the new filename again.
>

To correct all misleading statements someone can spread across internet:
Bacula will always backup the file on Incremental or Differential backups
which fullname (path+filename) does not exist at previous backups (some
additional restrictions/conditions apply). It is a true for both Bacula
Community and Bacula Enterprise and I believe it is a true for virtually
every backup system you have in the wild. No exceptions. This is a
fundamental backup functionality.
The main difference you can get using different backup software (i.e. BC
vs. BEE+Deduplication) is the content size stored in archive. Some software
can compress (as a deduplication is a kind of data compression) the file
content to achieve smaller data archive. This is what Bacula Enterprise
with GED or Aligned volumes (*) try to do.
*) To be correct Aligned volumes does not make deduplication but allow
third party external deduplication software/hardware to makes the best.

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula driver misconceptions

[Radosław Korzeniewski]

Hello,

2017-08-23 17:06 GMT+02:00 Dimitri Maziuk :

> On 2017-08-22 21:26, Heitor Faria wrote:
>
> It usually cost a new tape library, a new set of tapes and coffee.
>> It is not that hard to migrate legacy backups if you use a backup
>> rotation strategy such as GFS and works in a common company with 1-5
>> maximum montly/yearly retention backups.
>>
>
> I repeat, how many times have *you* done it, how many tapes, and how much
> did it cost you? In hardware, your time, and energy bills?
>
>
I did it once. Does it counts?

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Incremental changed to Full

[Maciolek, Mark]

From: Radosław Korzeniewski [mailto:rados...@korzeniewski.net]
Sent: Monday, September 11, 2017 10:40 AM
To: Maciolek, Mark 
Cc: Bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Incremental changed to Full

Hello,

2017-09-11 14:09 GMT+02:00 Maciolek, Mark 
>:
Hi,

Bacula Version: 9.0.3,  First full finished yesterday afternoon, the 
incremental scheduled for 1am(Job id 17) changed to a Full


06-Sep 01:05 maux-dir JobId 17: No prior Full backup Job record found.
06-Sep 01:05 maux-dir JobId 17: No prior or suitable Full backup found in 
catalog. Doing FULL backup.

Your previous Full job (jobid 16) finished at:  10-Sep-17 16:30 but above 
messages are from: 06-Sep 01:05.
So, it seems that you had a jobid 17 started when your last Full (jobid 16) was 
still running, so messages and Bacula behavior are correct, IMHO.

best regards
--
Radosław Korzeniewski
rados...@korzeniewski.net

Hi,

The full took over 5 days (47Tb) so job 17 was in the schedule before it 
finished, so I should change my schedule to do a Full the first Sunday of the 
month and then only incremental starting on the second Sunday of the month?

Mark
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula driver misconceptions

[Radosław Korzeniewski]

Hello,

2017-08-22 17:01 GMT+02:00 Dimitri Maziuk :

>
> However if you want to backup to removable disks and put them on the shelf
> when full, that's where things get less than perfect fast.
>
>
And make it behave like a tape when you complain it is not a tape. :)

P.S. Please excuse my joke above. I can't stop to write it.

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Incremental changed to Full

[Phil Stracchino]

On 09/11/17 10:40, Radosław Korzeniewski wrote:
> Hello,
> 
> 2017-09-11 14:09 GMT+02:00 Maciolek, Mark  >:
> 
> Hi,
> 
> Bacula Version: 9.0.3,  First full finished yesterday afternoon, the
> incremental scheduled for 1am(Job id 17) changed to a Full
> 
> 
> 06-Sep 01:05 maux-dir JobId 17: No prior Full backup Job record found.
> 06-Sep 01:05 maux-dir JobId 17: No prior or suitable Full backup
> found in catalog. Doing FULL backup.
> 
> 
> Your previous Full job (jobid 16) finished at:  10-Sep-17 16:30 but
> above messages are from: 06-Sep 01:05.
> So, it seems that you had a jobid 17 started when your last Full (jobid
> 16) was still running, so messages and Bacula behavior are correct, IMHO.


If you don't want this to happen in future, you might consider setting
Allow Duplicate Jobs = No, Cancel Queued Duplicates = yes in each Job or
JobDefs definition.  This will prevent a new instance of any backup job
from being started, even if called for by the schedule, while an
existing instance of the same job is still running.


-- 
  Phil Stracchino
  Babylon Communications
  ph...@caerllewys.net
  p...@co.ordinate.org
  Landline: +1.603.293.8485
  Mobile:   +1.603.998.6958

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Renamed and moved files are backed up again

[Radosław Korzeniewski]

Hello,

2017-09-05 8:57 GMT+02:00 Fabian Brod :

> Thanks for the answer.
>
> But what makes it for sense that a moved file with the same MD5 sum is
> saved again?
> It works as if only the complete path to the file is compared. Does anyone
> use Deduplication?
>

If you want to use real deduplication, please use Bacula Enterprise
Deduplication. It compares blocks not files.
It is not possible (or totally useless) to make MD5 only based file level
deduplication.

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Incremental changed to Full

[Radosław Korzeniewski]

Hello,

2017-09-11 14:09 GMT+02:00 Maciolek, Mark :

> Hi,
>
> Bacula Version: 9.0.3,  First full finished yesterday afternoon, the
> incremental scheduled for 1am(Job id 17) changed to a Full
>
>
> 06-Sep 01:05 maux-dir JobId 17: No prior Full backup Job record found.
> 06-Sep 01:05 maux-dir JobId 17: No prior or suitable Full backup found in
> catalog. Doing FULL backup.
>

Your previous Full job (jobid 16) finished at:  10-Sep-17 16:30 but above
messages are from: 06-Sep 01:05.
So, it seems that you had a jobid 17 started when your last Full (jobid 16)
was still running, so messages and Bacula behavior are correct, IMHO.

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Incremental changed to Full

[Maciolek, Mark]

Hi,

Bacula Version: 9.0.3,  First full finished yesterday afternoon, the 
incremental scheduled for 1am(Job id 17) changed to a Full


06-Sep 01:05 maux-dir JobId 17: No prior Full backup Job record found.
06-Sep 01:05 maux-dir JobId 17: No prior or suitable Full backup found in 
catalog. Doing FULL backup.
10-Sep 16:34 maux-dir JobId 17: Start Backup JobId 17, 
Job=BackupClient-to-disk.2017-09-06_01.05.00_06

This is the Job list showing the Full job #16 finished okay. 

16  Full6,377,14847.42 T  OK   10-Sep-17 16:30 BackupClient-to-disk
17  Full1,773,8646.582 T  Cancel   11-Sep-17 07:20 
BackupClient-to-disk



>From bacula-dir:

Director {# define myself
  Name = maux-dir
  DIRport = 9101# where we listen for UA connections
  QueryFile = "/etc/bacula/query.sql"
  WorkingDirectory = "/opt/bacula/working"
  PidDirectory = "/var/run"
  Maximum Concurrent Jobs = 20
  Password = "LFzYj4tQJHwcsBngTyEpPVzq/wKaXLFUCoogPz0IkmPv" # Console 
password
  Messages = Daemon
}

JobDefs {
  Name = "DefaultJob"
  Type = Backup
  Level = Incremental
  Client = maux-fd
  FileSet = "Full Set"
  Schedule = "WeeklyCycle"
  Storage = File
  Messages = Standard
  Pool = Default
  SpoolAttributes = yes
  Priority = 10
  Write Bootstrap = "/opt/bacula/working/%c.bsr"
}

Job {
  Name = "BackupClient-to-disk"
  Client = merrimack
  JobDefs = "DefaultJob"
  Storage = File
  Pool = Default
}

Schedule {
  Name = "WeeklyCycle"
  Run = Full 1st sun at 01:05
  Run = Incremental mon-sat at 1:05
}

# List of files to be backed up
FileSet {
  Name = "Full Set"
  Include {
Options {
  signature = MD5
}
#
#  Put your list of files here, preceded by 'File =', one per line
#or include an external list with:
#
#File = From what I have already googled I know the Job name , Client and File set 
>can't be changed or it comes becomes a Full. 

So what is wrong with my config?

Mark


--Mark Maciolek
Network Administrator
Morse Hall Rm 338
http://www.unh.edu/research/support-units/research-computing-center


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula 9.0.3 tape pool definition reports incorrectly

[Martin Simmons]

BAT seems not to use the Maximum Volume Bytes when it calculates the % used
(it uses the average amount used per tape for each MediaType according to the
source code).

"Better" is subjective, but I think Maximum Volume Bytes is meaningless if you
use hardware compression on the tapes (unless you don't care about wasting
tape space).

__Martin


> On Fri, 8 Sep 2017 13:52:22 +, Hicks, Daniel CTR OSD DMEA said:
> 
> Hello, 
> 
>  
> 
> I am using Bacula 9.0.3 on Centos7 and have the following issue when
> reviewing storage from bat. I am using LTO-5 tapes that are 1.5TB raw and
> 3TB compressed. I believe that I have set the Bacula-dir.conf tape pool
> definition correctly but when I look at bat after a single job wrote to
> tape. That job consisting of 479MG in size but bat reports that 48% of the
> tape is used. 
> 
>  
> 
> Please let me know if there is better way to define the tapes and if so
> where and how. 
> 
>  
> 
>  
> 
> # Tape pool definition
> 
> Pool {
> 
>   Name = Tape
> 
>   Pool Type = Backup
> 
>   Recycle = yes
> 
>   AutoPrune = yes
> 
>   Volume Retention = 5 years
> 
>   Maximum Volume Bytes = 1500G
> 
>   Storage = HP-Overland-TL
> 
> }
> 
>  
> 
> Thanks
> 
>  
> 
> Daniel Hicks
> 
> Senior Systems Analyst
> 
> DMEA IT Support

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Could not stat "/mnt/nas1stuff/": ERR=Host is down

[Ian Douglas]

On Thursday, 08 June 2017 2:49:52 AM SAST Ivan Adzhubey wrote:

> Looks like your directory is set up to automount and Bacula does not know
> how to handle it properly. You might need to write a small Bash script
> doing just what you tried manually: "cd /home/ian/nas1stuff/; ls -lh" and
> then specify it as RunBeforeJob in your director's config. Note, cd into
> automounted directory followed by ls would "enable" the mount and make it
> visible to Bacula.

FWIW, and just wrapping up the thread for future reference, the problem went 
away when I upgraded my Linux kernel. Which I found odd, but there it is ...

Cheers, Ian


-- 
i...@zti.co.za http://www.zti.co.za
Zero 2 Infinity - The net.works
Phone +27-21-975-7273

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users