Re: AWS Snapshots without FedoraGroup tag

2023-11-06 Thread Miroslav Suchý 

Dne 06. 11. 23 v 20:45 Kevin Fenzi napsal(a):

Can we get what volume they are snapshots of? Perhaps the volume name
would help us figure things out?


Most of the 6GiB volumes like snap-098326d474a07f706 is snapshot of vol- which does not exist (this snapshot is 
from 2018)


Even if I take

snap-0fdf88e3527a6ca6e (fedora-coreos-39.20231101.1.0-x86_64)
that was created

Fri Nov 03 2023 04:12:53 GMT+0100

with description
Copied for DestinationAmi ami-0e62f1adedc546f4d from SourceAmi ami-0b9d8baf52b75e62c for SourceSnapshot 
snap-033116129e665e380. Task created on 1,698,981,171,355.Copied for DestinationAmi ami-0e62f1adedc546f4d from SourceAmi 
ami-0b9d8baf52b75e62c for SourceSnapshot snap-033116129e665e380. Task created on 1,698,981,171,355.Copied for 
DestinationAmi ami-0e62f1adedc546f4d from SourceAmi ami-0b9d8baf52b75e62c for SourceSnapshot snap-033116129e665e380. 
Task created on 1,698,981,171,355.Copied for DestinationAmi ami-0e62f1adedc546f4d from SourceAmi ami-0b9d8baf52b75e62c 
for SourceSnapshot snap-033116129e665e380. Task created on 1,698,981,171,355. as snapshot of vol-

that does not exists.

Hmm, 
fromhttps://docs.aws.amazon.com/AWSEC2/latest/UserGuide/creating-an-ami-ebs.html
  :

During the AMI-creation process, Amazon EC2 creates snapshots of your instance's root volume and any other EBS volumes 
attached to your instance. You're charged for the snapshots until you deregister the AMI 
 and delete the snapshots. If any volumes 
attached to the instance are encrypted, the new AMI only launches successfully on instances that support Amazon EBS 
encryption .



--
Miroslav Suchy, RHCA
Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue

Re: AWS Snapshots without FedoraGroup tag

2023-11-06 Thread Kevin Fenzi 
On Thu, Nov 02, 2023 at 10:32:20AM +0100, Miroslav Suchý wrote:
> We have (almost) all instances and volumes properly tagged. Now let check 
> Snapshots.

Thanks for continuing to drive this forward. ;)

> OMG - there are A LOT of them. The list has 97k lines! Because of the size I
> will not attach it and instead provide link to download it:
> https://k00.fr/8p59mvcw
> 
> If you help me to identify something, I can either delete or tag it for you.
> 
> Few things I spotted:
>  * snapshots of volumes that no longer exists. Can it be deleted?
>  * lots of snapshots like fedora-coreos-36.20221030.2.3-aarch64 - do we still 
> need 36 and older?
>  * Fedora-Cloud-Base-29-20190729.0.x86_64-hvm-us-east-1-standard-0 - is this
> snapshots used to generate AMIs for getfedora.org? Do we still need it?
> 
> If you have snapshots that are important, please check that it have tag 
> FedoraGroup=*

So, if the non coreos ones are mostly fedimg, it doesn't tag things. ;( 
It predates our tagging setup entirely...

I've not dug into it, but yeah, I think it uses snapshots to make the
ami's... but it's unclear to me if it does or should clean those up
after the ami is made?

https://github.com/fedora-infra/fedimg/blob/develop/docs/services/ec2.md

I'm not sure how we can tell which of these are fedimg related and wich
aren't. Can we tell when something was created? I guess we could mount
them on a instance and see whats in them, but that doesn't seem
practical for 97k snapshots. ;) 

Can we get what volume they are snapshots of? Perhaps the volume name
would help us figure things out?

Open to ideas on how to clean it up. 

kevin


signature.asc
Description: PGP signature
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue