Re: [Bacula-users] Retention period calculation

2023-01-31 Thread Justin Case
Thanks for clarifying this, Ana,

so if I wanted my tier 1 storage to keep backups for 60 days, and my tier 2 
storage to keep backups for 120 days, would it be the best to set the retention 
periods as follows in the different resources:?
• client resources:
• file retention: 60
• job retention: 60
• tier1 pool resources:
• volume retention 70
• tier 2 pool resources:
• file retention 120
• job retention 120
• volume retention 130

Or what else would you propose?

Thank you for your time and effort!
 j/c

> On 31. Jan 2023, at 10:56, Ana Emília M. Arruda  
> wrote:
> 
> Hello Justin,
> 
> Sorry for the confusion!
> You are right, we recommend that *VolumeRetention is greater than or equal to 
> JobRetention".
> 
> So, the Volume will never get pruned before the Job Retention has expired.
> 
> Hope it is clear now.
> 
> Best,
> Ana
> 
> On Tue, Jan 31, 2023 at 10:43 AM Justin Case  wrote:
> Hi Ana, see below
> 
>> On 31. Jan 2023, at 10:16, Ana Emília M. Arruda  
>> wrote:
>> 
>> Hello Justin,
>> 
>> The problem is that you expect the Job doesn't get pruned from the Catalog 
>> (Job and File records deleted from the Bacula database) *before* the 
>> JobRetention value expires.
>> If you have a lower VolumeRetention and the volume gets pruned by using 
>> "prune volume expired yes", your jobs will be pruned before the JobRetention 
>> value.
>> 
>> And when the volume gets pruned, volstatus=Purged, it can be potentially 
>> reused by Bacula or truncated and the job data in the volume gets deleted.
>> 
>> This is why we usually recommend:
>> 
>> JobRetention greater than or equal to VolumeRetention
> 
> In your earlier mail you recommended the opposite:
> 
> 
>> On 30. Jan 2023, at 19:02, Ana Emília M. Arruda  
>> wrote:
>> 
>>  I strongly recommend you to set JobRetention less than or equal to 
>> VolumeRetention to avoid the volume to be pruned before the Job Retention 
>> has expired.
> 
> 
> Which is preferred?
> 
> 



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Retention period calculation

2023-01-31 Thread Ana Emília M . Arruda
Hello Justin,

Sorry for the confusion!
You are right, we recommend that *VolumeRetention is greater than or equal
to JobRetention".

So, the Volume will never get pruned before the Job Retention has expired.

Hope it is clear now.

Best,
Ana

On Tue, Jan 31, 2023 at 10:43 AM Justin Case  wrote:

> Hi Ana, see below
>
> On 31. Jan 2023, at 10:16, Ana Emília M. Arruda 
> wrote:
>
> Hello Justin,
>
> The problem is that you expect the Job doesn't get pruned from the Catalog
> (Job and File records deleted from the Bacula database) *before* the
> JobRetention value expires.
> If you have a lower VolumeRetention and the volume gets pruned by using
> "prune volume expired yes", your jobs will be pruned before the
> JobRetention value.
>
> And when the volume gets pruned, volstatus=Purged, it can be potentially
> reused by Bacula or truncated and the job data in the volume gets deleted.
>
> This is why we usually recommend:
>
> JobRetention greater than or equal to VolumeRetention
>
>
> In your earlier mail you recommended the opposite:
>
>
> On 30. Jan 2023, at 19:02, Ana Emília M. Arruda 
> wrote:
>
>  I strongly recommend you to set JobRetention less than or equal to
> VolumeRetention to avoid the volume to be pruned before the Job Retention
> has expired.
>
>
>
> Which is preferred?
>
>
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Retention period calculation

2023-01-31 Thread Justin Case
Hi Ana, see below

> On 31. Jan 2023, at 10:16, Ana Emília M. Arruda  
> wrote:
> 
> Hello Justin,
> 
> The problem is that you expect the Job doesn't get pruned from the Catalog 
> (Job and File records deleted from the Bacula database) *before* the 
> JobRetention value expires.
> If you have a lower VolumeRetention and the volume gets pruned by using 
> "prune volume expired yes", your jobs will be pruned before the JobRetention 
> value.
> 
> And when the volume gets pruned, volstatus=Purged, it can be potentially 
> reused by Bacula or truncated and the job data in the volume gets deleted.
> 
> This is why we usually recommend:
> 
> JobRetention greater than or equal to VolumeRetention

In your earlier mail you recommended the opposite:


> On 30. Jan 2023, at 19:02, Ana Emília M. Arruda  
> wrote:
> 
>  I strongly recommend you to set JobRetention less than or equal to 
> VolumeRetention to avoid the volume to be pruned before the Job Retention has 
> expired.


Which is preferred?


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Retention period calculation

2023-01-31 Thread Ana Emília M . Arruda
Hello Justin,

The problem is that you expect the Job doesn't get pruned from the Catalog
(Job and File records deleted from the Bacula database) *before* the
JobRetention value expires.
If you have a lower VolumeRetention and the volume gets pruned by using
"prune volume expired yes", your jobs will be pruned before the
JobRetention value.

And when the volume gets pruned, volstatus=Purged, it can be potentially
reused by Bacula or truncated and the job data in the volume gets deleted.

This is why we usually recommend:

JobRetention greater than or equal to VolumeRetention

This guarantees that jobs get pruned only when JobRetention has expired.
And your data is safe in the volume at least until JobRetention is reached.

Best,
Ana

On Tue, Jan 31, 2023 at 12:23 AM Justin Case  wrote:

> Hello Ana,
>
> I though about what you wrote and I am still wondering what would be the
> problem if a volume gets purged before the contained jobs retentions
> expire? This would remove the jobs and the corresponding files also from
> the catalog, ok, but where is the problem?
> I am Just trying to get a better understanding.
>
> Best
>  j/c
>
> On 30. Jan 2023, at 19:02, Ana Emília M. Arruda 
> wrote:
>
> Hello Antonino,
>
> I'm not sure I've understood your question. What does you mean by
> "CATALOGRETENTION"?
>
> There are only three retention values in Bacula: File, Job and Volume. I
> strongly recommend you to set JobRetention less than or equal to
> VolumeRetention to avoid the volume to be pruned before the Job Retention
> has expired.
>
> Best,
> Ana
>
> On Sat, Jan 28, 2023 at 11:26 AM Antonino Balsamo <
> a.bals...@officinapixel.com> wrote:
>
>> Hello,
>>
>> I have a shell script generating my bacula configs.
>>
>> Is there any enhancements, error or whatever in calculating the retention
>> period as per below?
>>
>> (it is a no-recycle scenario)
>>
>> #days to keep records in months, min 
>> 1RETENTION=2FILERETENTION=$(($RETENTION*30+40))
>> VOLUMERETENTION=$(($RETENTION*30+40))
>> JOBRETENTION=$(($RETENTION*30+90))
>> CATALOGRETENTION=$(($RETENTION*30+90))
>>
>>
>> thanks
>>
>> Antonino
>>
>>
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
>
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Retention period calculation

2023-01-30 Thread Justin Case
Hello Ana,

I though about what you wrote and I am still wondering what would be the 
problem if a volume gets purged before the contained jobs retentions expire? 
This would remove the jobs and the corresponding files also from the catalog, 
ok, but where is the problem?
I am Just trying to get a better understanding.

Best
 j/c

> On 30. Jan 2023, at 19:02, Ana Emília M. Arruda  
> wrote:
> 
> Hello Antonino,
> 
> I'm not sure I've understood your question. What does you mean by 
> "CATALOGRETENTION"?
> 
> There are only three retention values in Bacula: File, Job and Volume. I 
> strongly recommend you to set JobRetention less than or equal to 
> VolumeRetention to avoid the volume to be pruned before the Job Retention has 
> expired.
> 
> Best,
> Ana
> 
> On Sat, Jan 28, 2023 at 11:26 AM Antonino Balsamo 
> mailto:a.bals...@officinapixel.com>> wrote:
> Hello,
> I have a shell script generating my bacula configs.
> 
> Is there any enhancements, error or whatever in calculating the retention 
> period as per below?
> 
> (it is a no-recycle scenario)
> 
> #days to keep records in months, min 1
> RETENTION=2
> 
> FILERETENTION=$(($RETENTION*30+40))
> VOLUMERETENTION=$(($RETENTION*30+40))
> JOBRETENTION=$(($RETENTION*30+90))
> CATALOGRETENTION=$(($RETENTION*30+90))
> 
> thanks
> 
> Antonino
> 
> 
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net 
> https://lists.sourceforge.net/lists/listinfo/bacula-users 
> 
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Retention period calculation

2023-01-30 Thread Ana Emília M . Arruda
Hello Antonino,

Please note that Job, File and Volume retention values are related to
"Catalog stuff". They are the retention of the Jobs and File records in the
Catalog.
Bacula doesn't touch the data in the volumes unless the volume gets reused
or truncated.
When you prune jobs, files or volumes, you are "deleting the jobs/files
records from the Catalog database".

If you prune a volume, it means you delete the jobs and files records
associated with this volume from the Catalog.

Thus, "CATALOGRETENTION" is not used in Bacula.

Hope this helps!

Best,
Ana

On Mon, Jan 30, 2023 at 7:13 PM Antonino Balsamo <
a.bals...@officinapixel.com> wrote:

> Thanks Ana and good spot.
>
> CATALOGRETENTION is the value I use for all catalog related stuff (job,
> file and volume), maybe is redundant...
>
> Updated calc:
>
> RETENTION=2FILERETENTION=$(($RETENTION*30+40))
> VOLUMERETENTION=$(($RETENTION*30+40))
> JOBRETENTION=$(($RETENTION*30+40))
> CATALOGRETENTION=$(($RETENTION*30+90))
>
> Cheers
> Ant
>
> Il 30/01/2023 19:02, Ana Emília M. Arruda ha scritto:
>
> Hello Antonino,
>
> I'm not sure I've understood your question. What does you mean by
> "CATALOGRETENTION"?
>
> There are only three retention values in Bacula: File, Job and Volume. I
> strongly recommend you to set JobRetention less than or equal to
> VolumeRetention to avoid the volume to be pruned before the Job Retention
> has expired.
>
> Best,
> Ana
>
> On Sat, Jan 28, 2023 at 11:26 AM Antonino Balsamo <
> a.bals...@officinapixel.com> wrote:
>
>> Hello,
>>
>> I have a shell script generating my bacula configs.
>>
>> Is there any enhancements, error or whatever in calculating the retention
>> period as per below?
>>
>> (it is a no-recycle scenario)
>>
>> #days to keep records in months, min 
>> 1RETENTION=2FILERETENTION=$(($RETENTION*30+40))
>> VOLUMERETENTION=$(($RETENTION*30+40))
>> JOBRETENTION=$(($RETENTION*30+90))
>> CATALOGRETENTION=$(($RETENTION*30+90))
>>
>>
>> thanks
>>
>> Antonino
>>
>>
>> ___
>> Bacula-users mailing list
>> Bacula-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/bacula-users
>>
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Retention period calculation

2023-01-30 Thread Antonino Balsamo

Thanks Ana and good spot.

CATALOGRETENTION is the value I use for all catalog related stuff (job, 
file and volume), maybe is redundant...


Updated calc:

RETENTION=2 FILERETENTION=$(($RETENTION*30+40))
VOLUMERETENTION=$(($RETENTION*30+40))
JOBRETENTION=$(($RETENTION*30+40))
CATALOGRETENTION=$(($RETENTION*30+90))

Cheers
Ant

Il 30/01/2023 19:02, Ana Emília M. Arruda ha scritto:

Hello Antonino,

I'm not sure I've understood your question. What does you mean by 
"CATALOGRETENTION"?


There are only three retention values in Bacula: File, Job and Volume. 
I strongly recommend you to set JobRetention less than or equal to 
VolumeRetention to avoid the volume to be pruned before the Job 
Retention has expired.


Best,
Ana

On Sat, Jan 28, 2023 at 11:26 AM Antonino Balsamo 
 wrote:


Hello,

I have a shell script generating my bacula configs.

Is there any enhancements, error or whatever in calculating the
retention period as per below?

(it is a no-recycle scenario)

#days to keep records in months, min 1 RETENTION=2 
FILERETENTION=$(($RETENTION*30+40))
VOLUMERETENTION=$(($RETENTION*30+40))
JOBRETENTION=$(($RETENTION*30+90))
CATALOGRETENTION=$(($RETENTION*30+90))


thanks

Antonino


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Retention period calculation

2023-01-30 Thread Ana Emília M . Arruda
Hello Antonino,

I'm not sure I've understood your question. What does you mean by
"CATALOGRETENTION"?

There are only three retention values in Bacula: File, Job and Volume. I
strongly recommend you to set JobRetention less than or equal to
VolumeRetention to avoid the volume to be pruned before the Job Retention
has expired.

Best,
Ana

On Sat, Jan 28, 2023 at 11:26 AM Antonino Balsamo <
a.bals...@officinapixel.com> wrote:

> Hello,
>
> I have a shell script generating my bacula configs.
>
> Is there any enhancements, error or whatever in calculating the retention
> period as per below?
>
> (it is a no-recycle scenario)
>
> #days to keep records in months, min 
> 1RETENTION=2FILERETENTION=$(($RETENTION*30+40))
> VOLUMERETENTION=$(($RETENTION*30+40))
> JOBRETENTION=$(($RETENTION*30+90))
> CATALOGRETENTION=$(($RETENTION*30+90))
>
>
> thanks
>
> Antonino
>
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Retention period calculation

2023-01-28 Thread Antonino Balsamo

Hello,

I have a shell script generating my bacula configs.

Is there any enhancements, error or whatever in calculating the 
retention period as per below?


(it is a no-recycle scenario)

#days to keep records in months, min 1 RETENTION=2 
FILERETENTION=$(($RETENTION*30+40))
VOLUMERETENTION=$(($RETENTION*30+40))
JOBRETENTION=$(($RETENTION*30+90))
CATALOGRETENTION=$(($RETENTION*30+90))


thanks

Antonino

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users