Re: garbage collect: free orphaned chunks from disks?

2023-03-08 Thread Heiko Schlittermann
Hi,

Jens Berg  (Mi 08 Mär 2023 10:06:34 CET):
> She does in the moment a tape (= slot) is re-used.
…
> Remember that amanda was initially designed to work with tapes and that

Olivier  (Mi 08 Mär 2023 11:46:37 CET):
> While the tape/slot could free the level 1 dumps for a-disk, there could be
> some DLE for other disks/hosts that are still valid on that tape/slot.


Yes, I know that amanda was designed for tapes initially (and I'm still
using it happily with tapes.).

The "disk garbage collection" was just a minor issue I found when
checking what space is available on one of our disk based backup
servers.

Thanks for the input.
-- 
Heiko


signature.asc
Description: PGP signature


Re: garbage collect: free orphaned chunks from disks?

2023-03-08 Thread Exuvo

I would also like to add that it is good to have backups from varying dates 
around in case the most recent backup is ex after a file was accidentally 
deleted and you need to restore it from an older backup.

Anton "exuvo" Olsson
   ex...@exuvo.se

On 2023-03-08 12:20, Heiko Schlittermann wrote:

Hi,

Jens Berg  (Mi 08 Mär 2023 10:06:34 CET):

She does in the moment a tape (= slot) is re-used.

…

Remember that amanda was initially designed to work with tapes and that

Olivier  (Mi 08 Mär 2023 11:46:37 CET):

While the tape/slot could free the level 1 dumps for a-disk, there could be
some DLE for other disks/hosts that are still valid on that tape/slot.


Yes, I know that amanda was designed for tapes initially (and I'm still
using it happily with tapes.).

The "disk garbage collection" was just a minor issue I found when
checking what space is available on one of our disk based backup
servers.

Thanks for the input.


Re: Get the used storage per DLE?

2023-03-08 Thread Ingo Schaefer
Hello Heiko,

I usually used the amrestore command to find out, which tapes I would need for 
restoring a particular point in time.

So this answers the question, which tapes (=storage) is used for backups of a 
particular DLE.

Yours,
Ingo

Am 8. März 2023, 08:10, um 08:10, Heiko Schlittermann  
schrieb:
>Hi,
>
>is there a way to find the storage that is used for a particular DLE?
>
>I didn't find anything that's easy.
>Using `amadmin info` seems to include the recent backups per level
>only.
>I can try iterating over the output of `amadmin find` and use the known
>chunk size and the number of chunks, but this seems to be fragile.
>
>Do we have an other existing command already, to do so?
>
>--
>Heiko


Re: garbage collect: free orphaned chunks from disks?

2023-03-08 Thread Jens Berg

On 08.03.2023 08:14, Heiko Schlittermann wrote:

- Does amanda delete these files? From the output of `amadmin find` it
   does not look as if it does.

She does in the moment a tape (= slot) is re-used.
Remember that amanda was initially designed to work with tapes and that 
using disks as backup media has been implemented by emulating a 
classical tape library. With real tapes it would be an extremely costly 
operation to fetch and (partially) overwrite all older backups of a DLE 
once a level 0 has been written. Sure, if amanda knew she was operating 
on disks rather than on tapes she could do so easily. But what would be 
the benefit?


Re: Get the used storage per DLE?

2023-03-08 Thread Heiko Schlittermann
Ingo Schaefer  (Mi 08 Mär 2023 11:15:34 CET):
> Hello Heiko,
> 
> I usually used the amrestore command to find out, which tapes I would need 
> for restoring a particular point in time.
> So this answers the question, which tapes (=storage) is used for backups of a 
> particular DLE.

amrestore tries to extract the dumps from tapes, doesn't it?
- our dumps are client-encrypted: amrestore on the server fails
- it can't handle split dumps (but our dumps are split)
- it doesn't seem to have an option to just output the needed parts

For now I'm going through the output of amadmin find and multiply the
found parts with the part size. It serves as a rough estimate and is
good enough.

-- 
Heiko


signature.asc
Description: PGP signature


Re: garbage collect: free orphaned chunks from disks?

2023-03-08 Thread Olivier
Hi,

> Given a series of dumps like
>
> a-host a-disk 1 1 1 0 1 1
>
> the left most level 1 dumps are worthless, because we already dropped
> the "base" level 0.

While the tape/slot could free the level 1 dumps for a-disk, there could be
some DLE for other disks/hosts that are still valid on that tape/slot.

I don't think Amanda has any way to free some specific DLE from a
tape/slot. It is only at the tape/slot level that a tape/slot can be
erased and reused.

Best regards,

Olivier