Re: Deleting old AMIs in AWS

2024-04-26 Thread Dusty Mabe


On 4/23/24 12:04, Miroslav Suchý wrote:
> Dne 23. 04. 24 v 3:31 odp. Dusty Mabe napsal(a):
>> If you don't mind give us until next week to finish up loose ends on this. 
>> We are already
>> adding the FedoraGroup=coreos tag to our snapshots/AMIs as we create them 
>> now, but we are
>> working on a script to go apply that tag to our existing images.
>>
>> https://github.com/coreos/fedora-coreos-tracker/issues/1605#issuecomment-2052373124
> 
> Sure no problem.
> 
> And thank you for working on this.

OK. This should now be done!

https://github.com/coreos/fedora-coreos-tracker/issues/1605#issuecomment-2080346216
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: Deleting old AMIs in AWS

2024-04-23 Thread Miroslav Suchý

Dne 23. 04. 24 v 3:31 odp. Dusty Mabe napsal(a):

If you don't mind give us until next week to finish up loose ends on this. We 
are already
adding the FedoraGroup=coreos tag to our snapshots/AMIs as we create them now, 
but we are
working on a script to go apply that tag to our existing images.

https://github.com/coreos/fedora-coreos-tracker/issues/1605#issuecomment-2052373124


Sure no problem.

And thank you for working on this.

--
Miroslav Suchy, RHCA
Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: Deleting old AMIs in AWS

2024-04-23 Thread Dusty Mabe


On 4/4/24 05:11, Miroslav Suchý wrote:
> Dne 04. 04. 24 v 4:06 dop. Dusty Mabe napsal(a):
>> If you don't mind let me try to get the FedoraGroup tag added to our CoreOS 
>> AMIs first.
>>
>> I'll try to set up something to get that done this week. 
> 
> Sure. I pause any deletion till end of the current freeze (scheduled to 
> 2024-04-16).

Hey Miroslav,

If you don't mind give us until next week to finish up loose ends on this. We 
are already
adding the FedoraGroup=coreos tag to our snapshots/AMIs as we create them now, 
but we are
working on a script to go apply that tag to our existing images.

https://github.com/coreos/fedora-coreos-tracker/issues/1605#issuecomment-2052373124

Dusty
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: Deleting old AMIs in AWS

2024-04-04 Thread Miroslav Suchý

Dne 04. 04. 24 v 4:06 dop. Dusty Mabe napsal(a):

If you don't mind let me try to get the FedoraGroup tag added to our CoreOS 
AMIs first.

I'll try to set up something to get that done this week.


Sure. I pause any deletion till end of the current freeze (scheduled to 
2024-04-16).

--
Miroslav Suchy, RHCA
Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: Deleting old AMIs in AWS

2024-04-02 Thread Kevin Fenzi
On Tue, Apr 02, 2024 at 09:39:46PM +0200, Miroslav Suchý wrote:
> Dne 02. 04. 24 v 7:45 odp. Kevin Fenzi napsal(a):
> > On Tue, Apr 02, 2024 at 07:13:56AM +0200, Miroslav Suchý wrote:
> > > Dne 14. 03. 24 v 9:58 dop. Miroslav Suchý napsal(a):
> > > > FYI I plan to continue in AWS cleanup on Friday.
> > > > 
> > > > I waited till Freeze is over - just to be safe. And now I want to delete
> > > > the old AMIs. Likely in several waves. Going from oldest to ~2021.
> > > I deleted all AMIs that does not have tag FedoraGroup and that were older 
> > > than 2019-01-01.
> > > 
> > > For the record, the list of deleted AMIs is in attachement. And the script
> > > that I used is
> > > https://github.com/xsuchy/fedora-infra-scripts/blob/main/delete-old-amis.py
> > > 
> > > The script deregistered 36996 AMIs. The associated snapshots still exists.
> > Hurray!
> > 
> > Thanks again for doing this.
> 
> You are welcome. But I have to say I am scared.
> I just ask myself: and centos AMIs are stored under which account?
> 
> Our account, is the answer!

Yep. ;( 

It is scary, but it should be done...

> So, I have just tagged all AMIs from
> 
> https://www.centos.org/download/aws-images/
> 
> with FedoraGroup=ga-archives

ok.

I suspect there's a lot fewer of them than the fedora ones?

> Any idea if I missed something else before I start deleting the more recent 
> ones?

I don't think so...

kevin


signature.asc
Description: PGP signature
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: Deleting old AMIs in AWS

2024-04-02 Thread Miroslav Suchý

Dne 02. 04. 24 v 7:45 odp. Kevin Fenzi napsal(a):

On Tue, Apr 02, 2024 at 07:13:56AM +0200, Miroslav Suchý wrote:

Dne 14. 03. 24 v 9:58 dop. Miroslav Suchý napsal(a):

FYI I plan to continue in AWS cleanup on Friday.

I waited till Freeze is over - just to be safe. And now I want to delete
the old AMIs. Likely in several waves. Going from oldest to ~2021.

I deleted all AMIs that does not have tag FedoraGroup and that were older than 
2019-01-01.

For the record, the list of deleted AMIs is in attachement. And the script
that I used is
https://github.com/xsuchy/fedora-infra-scripts/blob/main/delete-old-amis.py

The script deregistered 36996 AMIs. The associated snapshots still exists.

Hurray!

Thanks again for doing this.


You are welcome. But I have to say I am scared.
I just ask myself: and centos AMIs are stored under which account?

Our account, is the answer!

So, I have just tagged all AMIs from

https://www.centos.org/download/aws-images/

with FedoraGroup=ga-archives

Any idea if I missed something else before I start deleting the more recent 
ones?


--
Miroslav Suchy, RHCA
Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: Deleting old AMIs in AWS

2024-04-02 Thread Kevin Fenzi
On Tue, Apr 02, 2024 at 07:13:56AM +0200, Miroslav Suchý wrote:
> Dne 14. 03. 24 v 9:58 dop. Miroslav Suchý napsal(a):
> > FYI I plan to continue in AWS cleanup on Friday.
> > 
> > I waited till Freeze is over - just to be safe. And now I want to delete
> > the old AMIs. Likely in several waves. Going from oldest to ~2021.
> 
> I deleted all AMIs that does not have tag FedoraGroup and that were older 
> than 2019-01-01.
> 
> For the record, the list of deleted AMIs is in attachement. And the script
> that I used is
> https://github.com/xsuchy/fedora-infra-scripts/blob/main/delete-old-amis.py
> 
> The script deregistered 36996 AMIs. The associated snapshots still exists.

Hurray!

Thanks again for doing this.

kevin


signature.asc
Description: PGP signature
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: Deleting old AMIs in AWS

2024-03-14 Thread Kevin Fenzi
On Thu, Mar 14, 2024 at 09:58:47AM +0100, Miroslav Suchý wrote:
> FYI I plan to continue in AWS cleanup on Friday.
> 
> I waited till Freeze is over - just to be safe. And now I want to delete the
> old AMIs. Likely in several waves. Going from oldest to ~2021.

Sure, but note that freeze is only over once we ship a beta. ;)

But I don't knot that this needs to wait on that.
It seems pretty safe.

> In this step I plan to keep the associated snapshots. So if I break something 
> we can still restore the AMI.
> 
> 
> BTW - quick summary where we are with the cleanup stuff:
> 
> * all VM, volumes have tag FedoraGroup
> 
> * all gp2 volumes are migrated to gp3
> 
> * All AMIs with name 'Fedora-AtomicHost-*' are deleted. Including associated 
> snapshots
> 
> * all Fedora GA AMIs and snapshots are tagged with FedoraGroup.
> 
> * all old (2021-) snapshots with no associated AMIs are deleted.

Thanks again for moving this forward.

kevin


signature.asc
Description: PGP signature
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Deleting old AMIs in AWS

2024-03-14 Thread Miroslav Suchý

FYI I plan to continue in AWS cleanup on Friday.

I waited till Freeze is over - just to be safe. And now I want to delete the old AMIs. Likely in several waves. Going 
from oldest to ~2021.


In this step I plan to keep the associated snapshots. So if I break something 
we can still restore the AMI.


BTW - quick summary where we are with the cleanup stuff:

* all VM, volumes have tag FedoraGroup

* all gp2 volumes are migrated to gp3

* All AMIs with name 'Fedora-AtomicHost-*' are deleted. Including associated 
snapshots

* all Fedora GA AMIs and snapshots are tagged with FedoraGroup.

* all old (2021-) snapshots with no associated AMIs are deleted.

--
Miroslav Suchy, RHCA
Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue