Re: Heads up - AWS Snapshots cleanup

2023-12-04 Thread Kevin Fenzi
On Sat, Dec 02, 2023 at 10:57:11PM +0100, Miroslav Suchý wrote:
> Dne 02. 12. 23 v 22:45 Miroslav Suchý napsal(a):
> > I wonder - do we have written retention policy for our images? Do we
> > want to keep the old one? Public ones? Private ones?
> 
> It seems that Fedora Atomic Host is EOLed since 2019-11-26
> https://projectatomic.io/blog/2019/11/fedora-atomic-host-nearing-eol/
> 
> The images for historical purposes are available at 
> https://dl.fedoraproject.org/pub/alt/atomic/stable/
> 
> So it seems to me that we can safely delete all AMIs with name 
> "Fedora-AtomicHost*'

Yeah, I would think so, yes. 

kevin


signature.asc
Description: PGP signature
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: Heads up - AWS Snapshots cleanup

2023-12-03 Thread Miroslav Suchý

Dne 29. 11. 23 v 8:36 Miroslav Suchý napsal(a):

On Friday (2023-12-01) I plan to delete all Snapshots that were created before 
2019 and do not have tag FedoraGroup.


This phase has finished. Any snapshot older than 2019 that remained is because AWS refused to delete it - likely because 
it is associated with AMI.


For the record this is the script I used:

https://github.com/xsuchy/fedora-infra-scripts/blob/main/delete-snapshots.py

--
Miroslav Suchy, RHCA
Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: Heads up - AWS Snapshots cleanup

2023-12-02 Thread Miroslav Suchý

Dne 02. 12. 23 v 22:45 Miroslav Suchý napsal(a):
I wonder - do we have written retention policy for our images? Do we want to keep the old one? Public ones? Private ones? 


It seems that Fedora Atomic Host is EOLed since 2019-11-26 
https://projectatomic.io/blog/2019/11/fedora-atomic-host-nearing-eol/


The images for historical purposes are available at 
https://dl.fedoraproject.org/pub/alt/atomic/stable/

So it seems to me that we can safely delete all AMIs with name 
"Fedora-AtomicHost*'

--
Miroslav Suchy, RHCA
Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: Heads up - AWS Snapshots cleanup

2023-12-02 Thread Miroslav Suchý

Dne 29. 11. 23 v 8:36 Miroslav Suchý napsal(a):

On Friday (2023-12-01) I plan to delete all Snapshots that were created before 
2019 and do not have tag FedoraGroup.

On next Friday (2023-12-08) I plan to delete all Snapshots that were created in 2021 and earlier and do not have tag 
Fedora Group.


I started with the cleanup. I started with 2018 and older. The script is running right now. It found lots of snapshots 
in eu-central-1. But surprisingly just few snapshots in ap-south-1 - most snapshots AWS rejected to delete because they 
were linked to AMI - mostly Fedora-AtomicHost-29-* We have plenty of them. See this screenshot:


  https://k00.fr/o0hxjyd0

I wonder - do we have written retention policy for our images? Do we want to 
keep the old one? Public ones? Private ones?

--
Miroslav Suchy, RHCA
Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: Heads up - AWS Snapshots cleanup

2023-11-28 Thread Miroslav Suchý

Dne 28. 11. 23 v 23:28 Sandro napsal(a):

On 28-11-2023 15:54, Miroslav Suchý wrote:

On Friday I plan to delete all Snapshots that were created before 2019 and do 
not have tag FedoraGroup.

On next Friday (2023-12-01) I plan to delete all Snapshots that were created in 2021 and earlier and do not have tag 
Fedora Group.


So, that's two different clean up activities on the same day? Or has an error crept in, since ("On Friday" == "next 
Friday (2023-12-01)") && ("created before 2019" != "created in 2021 and earlier"?



Ah, I screwed the dates, It should be:

On Friday (2023-12-01) I plan to delete all Snapshots that were created before 
2019 and do not have tag FedoraGroup.

On next Friday (2023-12-08) I plan to delete all Snapshots that were created in 2021 and earlier and do not have tag 
Fedora Group.




--
Miroslav Suchy, RHCA
Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: Heads up - AWS Snapshots cleanup

2023-11-28 Thread Sandro

On 28-11-2023 15:54, Miroslav Suchý wrote:
On Friday I plan to delete all Snapshots that were created before 2019 
and do not have tag FedoraGroup.


On next Friday (2023-12-01) I plan to delete all Snapshots that were 
created in 2021 and earlier and do not have tag Fedora Group.


So, that's two different clean up activities on the same day? Or has an 
error crept in, since ("On Friday" == "next Friday (2023-12-01)") && 
("created before 2019" != "created in 2021 and earlier"?


-- Sandro
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Heads up - AWS Snapshots cleanup

2023-11-28 Thread Miroslav Suchý

HEADS UP

On Friday I plan to delete all Snapshots that were created before 2019 and do 
not have tag FedoraGroup.

On next Friday (2023-12-01) I plan to delete all Snapshots that were created in 2021 and earlier and do not have tag 
Fedora Group.


This will be done in all regions.

As mentioned in different thread in this ML we have ten thousands of snapshots and it is impossible to evaluate each of 
them separately.


If you are aware of something that should be preserved, let me know. Or better, 
tag it.

--
Miroslav Suchy, RHCA
Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue